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Integrate and Fire Neural Networks, 
Piecewise Contractive Maps and Limit Cycles. 
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Abstract 

We study the global dynamics of integrate and fire neural networks composed 
of an arbitrary number of identical neurons interacting by inhibition and excitation. 
We prove that if the interactions are strong enough, then the support of the stable 
asymptotic dynamics consists of limit cycles. We also find sufficient conditions for 
■ the synchronization of networks containing excitatory neurons. The proofs are based 

on the analysis of the equivalent dynamics of a piecewise continuous Poincare map 
^ ■ associated to the system. We show that for efficient interactions the Poincare map 

is piecewise contractive. Using this contraction property, we prove that there exist 
a countable number of limit cycles attracting all the orbits dropping into the stable 
subset of the phase space. This result applies not only to the Poincare map under 
study, but also to a wide class of general n-dimcnsional piecewise contractive maps. 
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' ■^ \ synchronization. 
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> " 1 Introduction 

in 

Numerous physical or biological systems can be seen as composed of a large number of 
units in interaction. In many occasions, their time evolution is modeled by a system of 
coupled differential equations, or by a high dimensional discrete time dynamical system. 
Those models take into account a proper individual dynamics for each unit and a coupling 
between units which may depend on the state of the whole system. Typical example of 
such models are coupled oscillators (continuous time) and coupled map lattices (discrete 
time) [10]. They usually assume well mathematically characterized individual dynamics, 
5_i " the main question under study being how the coupling of units can generate the collective 



behaviors observed in physical and biological systems. Nevertheless, from a mathematical 
point of view, these systems are a source of open problems and most mathematical results 
have been proved under the assumption of weak coupling and/or focus on particular 
solutions [28]. 

Pulse-coupled oscillators appear frequently in biological sciences, in particular in neu- 
roscience to model neural networks [21]. In this context, the state of each oscillator 
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describes the difference of electrical potential between the inside and the outside of a neu- 
ron's membrane. An archetype of pulse-coupled neural network appears in literature [19] 
in the following form: 

n 

Vi = fi(V i ) + ^h ji (V i )5(t-t j ) Vie {1,..., n}. (1) 
i=i 

The solutions of the non-coupled equation Vi = fi(Vi) define the individual dynamics of 
the membrane potential of the neuron i. The following additional rule is assumed: if 
the potential Vi reaches the so called threshold potential 9 > at an instant denoted U, 
then the neuron i is said to fire (or to emit a spike) and its potential is reset to zero. 
The term hji(Vi)5(t — tj) is a short hand notation meaning that at time tj the potential 
of the neuron i suffers a discontinuity jump of amplitude hji(Vi(tJ)). This discontinuity 
hji is produced by the firing of the presynaptic neuron j on the potential Vi(tJ) of the 
postsynaptic neuron i. If the jump is negative (hji < 0) the interaction is said inhibitory 
and if it is positive (hji > 0) it is said excitatory. 

When weak interactions are assumed, and extra conditions on fi are imposed, it is 
possible to reduce (1), and also more realistic neural models, to a canonical system of 
phase coupled oscillators [17, 18]. This opens the possibility to get some insight in the 
dynamics of a huge class of weakly coupled neural networks by studying for example 
the existence and the stability of synchronized states [13, 17, 19]. Further insight in 
the dynamics of neural networks can be obtained by considering specific models. In this 
respect (leaky) Integrate and Fire (IF) neural networks [15] are certainly the most popular. 
For these networks fi is a real affine function. Many mathematical works on IF neural 
networks deal with the dependence of particular solutions on the parameters describing 
the interactions (that are not necessarily impulsive). The effect of the velocity of the 
interactions on the stability of synchronized and anti-synchronized states is detailed for 
weak excitatory and inhibitory interactions in the case of two [26, 11] or more neurons 
[27] and in presence of delay [11], [2]. Synchronized solutions and more generally phase- 
locked solutions are also studied in the case of strong coupling for different architectures 
of network [2]. 

Although important results about the phenomenology of IF neural networks have been 
obtained, they principally focus on particular solutions, and there is still few mathematical 
results about their global dynamics, possibly letting unknown important features of neural 
networks. The purpose of this paper is precisely to give a mathematical description, 
developing analytical proofs, of the global dynamics of IF neural networks. In spite of IF 
neural networks being continuous time dynamical systems, as far as we know, previous 
studies of their global dynamics develop methods of discrete time dynamical systems. In 
their seminal work [23] study a Poincare return map to prove that for the system (1) 
with homogeneous constant excitatory interactions (hji = cte > 0) and homogeneous 
individual dynamics (fi = /), almost all orbits become synchronized. In [9] a discrete 
time IF neural network, which may be seen as a discretization of (1) by a formal Euler 
scheme, is studied. The corresponding dynamical system is defined by the iterations of a 
general piecewise affine map. It is proved that for generic values of the parameters, the 
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global asymptotic dynamics is supported on a finite number of stable periodic orbits. It is 
also proved that for non generic values of the parameters, asymptotic dynamics is sensitive 
to initial conditions. 

Motivated by the rigorous results of [9], which are proved for discrete time system, the 
question we address in this paper is if they are also true for continuous time IF neural 
networks. Although elaborated integration schemes, especially designed for the simulation 
of neural networks have been developed [3] , there is no way to completely eliminate numer- 
ical errors. Thus, the results of simulations can drastically depend on the used integration 
strategy [25]. This motivates the interest of developing rigorous mathematical proofs also 
in the continuous time case. In this respect, the previous works [5, 7, 20] proved that 
periodic orbits attract almost all initial conditions, but under the assumption that the 
interactions are all inhibitory, while arbitrary interactions are considered in [9]. 

The main property allowing the proof of these results is that the (return) map is 
piecewise contractive in the whole phase space. In Section 2, we derive the return map of 
(1), assuming fi(Vi) = —^Vi+K, the independence of hji on Vi, and other hypothesis ((HI) 
and (H2), stated in the same section) giving a precise meaning to (1). In Section 3, we 
investigate the contraction properties of the return map. We prove that, unexpectedly, it 
is not piecewise contractive in the whole phase space for an open region of the interactions 
values, if some of them are excitatory (Theorem 2). Nevertheless, we find also an open 
subset in the space of parameters such that this return map is piecewise contractive in 
the whole phase space, with respect to an adapted metric (Theorem 3). This parameters 
subset is defined by hypothesis (H3) and (H4) stated in Section 3. 

We give now a short version of our results about the global dynamics of IF neural 
networks: 

Theorem 1.1) Under Hypothesis (HI), if the neural network is completely excitatory 
and the number of neurons is sufficiently large, then all the orbits are eventually periodic 
and synchronized. 

2) Under the hypothesis (HI), (H2), (H3) and (H4), if the neural network contains in- 
hibitory neurons, then the stable orbits are attracted by a countable number of limit cycles. 

The part 1) of this theorem is reformulated in Theorem 4, which is proved in Section 
4. Its proof is done only under hypothesis (HI), but the hypothesis of existence of a large 
number of neurons is necessary. In fact, if the neural network is completely excitatory, but 
the number of neurons is not sufficiently large (in relation with the minimum amplitude of 
the synaptic interactions), then there exist orbits that are never synchronized (Proposition 
4.2). 

The part 2) follows from Theorem 5 in Section 5. This last theorem states that the 
stable asymptotic dynamics of the return map is supported by periodic orbits. However, 
it does not prevent the system from exhibiting a weak form of chaos. In particular, stable 
chaos 

[24] exists because of the coexistence of an uncountable set of sensitive states. The 
distance between the limit cycles (attracting all the stable dynamics) and the sensitive 
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points influences the period of the cycles and determines the effects of small perturbations 
(rounding errors, stochastic perturbations). The expected effects are the existence of long 
transient times and of cycles of large period, provided the sensitive points and the stable 
points are sufficiently intricate. 

The proof of Theorem 5 does not use the particular formulation of the return map. It 
applies to a wide class of piecewise contractive maps (see Definition 5.2). Previous results 
[1, 4, 6, 9, 14], stating the existence of periodic attractors for piecewise contractive maps, 
are proved in a different context. In [1] the maps are one dimensional and injective. In 
the works studying higher dimensional dynamics, only affine maps [9, 4] or injective maps 
[6] are considered. In our case none of these hypothesis is assumed, since the proof applies 
to n-dimensional maps, that are neither necessarily piecewise affine nor globally injective. 

2 Integrate and fire neural network 

We propose to study the global dynamics of leaky integrate and fire neural networks. Our 
working model is a standard IF neural network considering an arbitrary number of neurons 
connected by inhibitory and excitatory synapses. This system, which is defined precisely 
in Subsection 2.1, is the model (1) with fi(Vi) = —7^ + K and where hji(Vi) = Hji is 
independent of V\. Its global dynamics is studied in the next sections via a Poincare map 
which is derived in Subsection 2.2. 

2.1 Definition of the model 

At each time t S R, the state of a neuron i £ I := {l,...,n} is described by its 
membrane potential Vi(t) and the state of the network is represented by the vector 
V(t) = (Vi(t), . . . , V n (t)). According to model (1), the time evolution of the network 
has two regimes: a sub-threshold regime and a firing regime. 

Equations of the sub-threshold regime: The sub-threshold regime occurs when 
Vi{t) < 9 for all i & I, where 9 > is called the threshold potential. In such a regime, the 
state of the network satisfies the system of differential equations defined by: 

Vi(t) = -yVi(t) + K Vie/. (2) 

The constant 7 > stands for 1/RC where R and C are respectively the resistance and 
the capacity of the neural membrane, and K = I ex t/C > is proportional to a constant 
external current I ext . According to Equation (2), the potential of each neuron tends to 
the equilibrium value: 

13:=- = Rhxt > 0. (3) 

7 

Equations of the firing regime: If we assume /3 > 9, and take an initial state V(0) 
such that Vi(0) < 9 for all i € I, then there exists a smallest time to (which depends on 
V(0)) when the potential of (at least) one neuron reaches the threshold. At this instant 
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the network enters in the firing regime: the neuron emits a spike that induces a change 
in the potential of all the neurons it is connected with, and its own potential is reset to 
a smaller value than the threshold, chosen equal to (without loss of generality, and as 
conventional for integrate and fire models). Therefore, when the network enters in the 
firing regime, its state suffers a discontinuity due to the reset of the firing neurons, and to 
the change of potential of the neurons receiving the spikes of the firing neurons. Formally, 
if J C / denote the set of all the neurons that reach 9 at time to, i.e. spontaneously (by 
the solution flow of equation (2)) or by an excitation produced by other neurons, the state 
of the network satisfies: 



The constant Hji represents the synaptic interaction triggered by a spike of the neuron j 
towards the neuron i. It is positive for an excitatory synapse, negative for an inhibitory 
synapse, and equal to if the neurons are not connected. Due to the instantaneous 
character of the reset and of the synaptic interactions, in presence of excitatory neurons, 
the dynamics of IF models of type (1) may be ill-defined or exhibit infinite firing rates 
when the network has some loops 3 , unless some kind of refractory period is considered. 
To ensure the model is well defined for any network, we suppose that a neuron which fires 
at time to, can neither receive nor emit a second spike at time to (right side of (4)). In this 
sense we consider a refractory phenomenon, which as well as the reset and the synaptic 
interactions is instantaneous. It results that the set J of the neurons that fire at time to 
has to be defined and computed carefully to take into account the refractory phenomenon. 
In Section 2.2, we write the exact mathematical definition of this set (formula (10) and 



Definition 2.1. We will say that a neuron j is excitatory (inhibitory) if all its synapses 
are excitatory (inhibitory), i.e Hji ^ (Hji ^ 0) for all i £ I such that j ^ i. We will say 
that a neuron is "mixed" if it is neither excitatory nor inhibitory, namely, if it does not 
satisfy Dale's principle (see [17] page 7). 

To prove Theorem 1 and other results along this paper, we will make the following 
hypothesis: 

(HI) The membrane potential of the neurons has a lower bound, i.e. there exists a < 
such that for all i £ I and t G R, we have Vi(t) a. 

(H2) If a neuron i suffers inhibitory and excitatory interactions at the same time, and 
if the sum of the excitatory interactions is large enough to make it reach the threshold 
potential, then the neuron i fires. 

3 For example, consider a loop of two neurons where neuron 1 is excitatory, neuron 2 is inhibitory, and 
the synaptic interactions are sufficiently large to lead to the following situation: the neuron 1 fires instan- 
taneously and induces the instantaneous firing of the neuron 2, but this last firing prevents instantaneously 
neuron f from firing. Then, the state of neuron f is undetermined. 




(4) 



(11)). 
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The hypothesis (HI) fits with the physical bounds of the electric potentials of real 
biological or electronic systems: the potential of a neuron can not be arbitrarily small. 
We do not specify any particular negative value for a. It is a parameter of the model 
which can change quantitative results, but has little impact on the qualitative dynamics 
of the network. 

The hypothesis (H2) is used only to determine the neurons that fire (those of the set 
J of the equation (4)), but both excitatory and inhibitory interactions are considered to 
update the states of the neurons that do not fire (r.h.s. of equation (4)). Hypothesis (H2) 
is a technical hypothesis that we need to prove our results, but it solves an indetermination 
that appears anyway in any network with instantaneous interactions and has a biological 
interpretation, as we explain now. In a model for which the interactions are not instanta- 
neous, during a short time interval r where the neuron are interacting, synaptic weights of 
different signs are added to the potential of the post-synaptic neuron in a certain order. If 
the sum of the excitatory weights is larger than the threshold but the total sum of synaptic 
weight is smaller than the threshold, in the time interval r, the following two situations 
can arise: 

1) Excitatory signals arrive first to a neuron i, and their sum is large enough to make 
it fire. Then, neuron i fires, and besides, due to the refractory period, the sum of the 
inhibitory signals that arrive delayed to neuron i does not change its potential Vi ~ 0. 

2) The same excitatory and inhibitory signals that in case 1) arrive to neuron i, but in the 
reverse order. Then Vi initially decreases and when the positive excitatory signals arrive 
delayed to the neuron i they are not enough to make it fire. 

When the interactions are instantaneous, it is possible that excitatory and inhibitory 
signals arrive to neuron i at the same time, since the time interval r while the neurons 
are interacting is collapsed to zero. The previous example shows that the algebraic sum of 
the excitations and the inhibitions received during the time interval r is not necessarily a 
realistic criterion to decide if the neuron i fires or not. Hypothesis (H2) is an alternative 
criterion, which coincides with the one of the algebraic sum in most situations, but assumes 
that the positive interactions act faster than the negative ones when an indetermination 
exists. It can also be seen as a way to take into account that excitatory synapsis are more 
frequent than inhibitory synapsis in some part of the nervous system [22]. 

2.2 The Poincare return map 

In order to analyze the global dynamics of the IF neural network, we reduce it to an 
equivalent discrete time dynamical system, namely a Poincare return map. In this section, 
we introduce all the important notions we use in the sequel of the paper. Among then 
we define a Poincare section in the phase space, we compute the waiting time before the 
spontaneous firing of the network, we explain in details the rules of the firing regime, 
we introduce a partition of the Poincare section which atoms are the sets of the initial 
conditions leading the same neurons to fire in the firing regime, and we derive a Poincare 
return map of the network. 
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Poincare section £: Since the potential of a neuron is always larger than a and always 
smaller than 9, the states of the network always belong to the re-dimensional space Q = 
[a, 9] n . By definition of the model, the network never stops to emit spikes (since (3 > 9). 
It exists then arbitrarily large times such that the potential of a neuron is reset to zero. 
In other words, any solution of the model returns infinitely many times to the set: 

£ = (J tj where Ej = {VeQ : Vj = 0}. (5) 

3=1 

The set £ is the Poincare section that we will consider. The topology we use is the one 
induced by the embedding £ C W 1 . Specifically, we consider in £ the metric derived from 
the supremun norm of M n , denoted II • II in this paper and defined by II VII = max \ VA. 

To sum up the principal steps of the construction of the return map, let us follow an 
orbit of the network. Suppose the initial state of the network is V £ £. If V is such that 
Vi < 9 for all i £ {1, . . . , n}, then the network is in the sub-threshold regime and there is 
a waiting time i(V) > before a neuron reaches the threshold potential. At the instant 
i(V) the network enters in the firing regime, and a set J(V) of neurons emit some spikes. 
The potential of these neurons is then reset to and the states of the other neurons that 
did not spike during the firing regime, because excitations were not enough, is updated 
according to the interactions received. The network is back in the sub-threshold regime in 
a point /o(V) of £, which is the value at point V of the return map p we want to construct. 
The formula of the return map is the same for all V sharing a same J(V), this why we 
will introduce a partition V of £ which atoms are precisely the points with a same J(V). 
Now we detailed the computation of i(V) > 0, J(V), V and p. 

Waiting time i(V): Solving the system (2) leads to the time t map (ft = (cj)\, . . . , 4>n) 
where for each i € I and ( £ R 

<t>i(Y) = {V t - P)e~' it + ^ VVGlR n (6) 

Thus, if at time t = the network is in the state V £ £, it enters in the firing regime at 
time: 

i(V) := min * 4 (V) where U{V) := inf{t ^ : $(V) ^ 9). (7) 
i€{l,...,n} 

Note that t(V) is the value of to of formula (4) when the initial state of the network is 
V. In the particular case where V £ £ is such that V% = 9 for some i, the waiting time is 
equal to 0, if not it is positive. Note also that if t(V) = ij(V) the expression of the time 
t map a time i(V) is given by 

4 (V) (V) = and ^r^) = P- iP ~^% 9) VM>. (8) 
We will often use this expression latter on. 

Firing regime t = t(V): By definition (7), at time i(V) some component of the vector 
^>H V )(V) are equal to 9; those corresponding to the neurons which potential reaches the 
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threshold in a smaller time than the potential of all the other neurons. We need to 
characterize this set of neurons that fire spontaneously because they are part of the set 
J of formula (4). It depends of course of the value of V (as well as J). This is why we 
introduce the following cover of E: 

n 

E = |J E< where Ej = {V £ E : t(V) = * 4 (V)}. (9) 

8=1 

A set Ej of this cover, is the set of the initial states in E such that the neuron i fires 
spontaneously after the waiting time t(V), that is, if V £ Ej then </>^ V ^(V) = 6. Since 
several neurons may reach 9 at the same time, these sets are not pairwise disjoint (and 
thus forms a cover instead of a partition of E), but they have pairwise disjoint interiors. 
We can states any way that the neurons that fires spontaneously at time i(V) are those 
of the set of indexes: 

J (V) = {ie/:Ve EJ. 

Now, the firing of the neurons of Jq(V) may instantaneously excite other neurons, 
which may also fire in turn at the same instant, and excite other neurons or not. One more 
time, we need to characterize all the neurons participating in this instantaneous avalanche 
process, i.e. the set J of formula (4), that we denote until now J(V). We can determine 
J(V) introducing a recursive sequence of sets of indexes { J m (V)} m ^0) where each J m (V) 
is the set of neurons that have fired once until the step m of the avalanche process. Taking 
into account the temporary inertia (the refractory period) of real neurons after firing, and 
considering Hypothesis (H2), this sequence must obey the following induction rule for all 
m ^ 1: 

J m (V) = J m _i(V) U {k e / \ J m _i(V) : 4 (V) (V) + J2 H ik> 0}- ( 10 ) 

jeJ m -i(V) :H ik >0 

As an example, Ji(V) contains the neurons of Jo(V) and possibly additional neurons that 
fire because of some excitatory interactions with the neurons of Jq(V). Note that this 
additional neurons, which are those of the second set of the union that defines Ji(V), 
cannot be neurons of Jo(V). In our definition (10), they are not considered as a possible 
receptors of spikes, in order to take into account of a refractory phenomenon in the model. 
Indeed, a set J m (V) is the disjoint union of the neurons of J m _i(V) with new neurons 
firing by interactions with those of J m _i(V). 

Since the set / is finite, there exists a tuq 0, such that no new neurons are incremented 
to J mo+ i(V) with respect to J mo (V), either because J mo _i(V) is the whole all set /, or 
because the sum of the excitatory interactions of the neurons of J mo _i(V) is not enough 
to make fire some new neurons. For such a tuq we have J mo (V) = J mo _i(V) and we can 
conclude that the set of the neurons that emit a spike at time i(V) can be written as: 

J(V)= U Jm(V) = Jmo(V)- (11) 
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If there is no excitatory neurons in Jo(V), then J m (V) = Jo(V) for all m G N and 
J(V) = Jq(V). If Jo(V) contains excitatory neurons, then J(V) may contain more 
neurons than Jq(V). 

Partition "P of E: As shown in the previous construction, to each initial state of the 
network V G £ it is associated the set J(V) of the neurons that fire at time i(V). So we 
can consider the function J(-) of E into the set P(I) of all the nonempty subsets of I and 
use its pre-images to get a partition V of E: 

7> = {Sj} JeP{/) where Ej = {V G E : J(V) = J}. (12) 

Given a set of neurons J € P(I), the set Ej is the set of all the initial states in E such that 
the neurons that fire after the waiting time t(V) are exactly those of J. For example, if 
V G then at time t(V), only the neuron i fires (which makes a difference with the set 
Ej of the cover (9)). Note that i(V) is not necessarily the same for each V in a same Ej. It 
is straightforward to check that V forms a partition of E: on one hand, to each V G E it is 
associated some J(V) and thus some Ej, and on the other hand, if V € EjflEj/ ^ then 
by definition J = J(V) = J' and Ej = Ej/. According to the values of the parameters of 
the model Hji,^,f3 and a, some Ej may be empty. Nevertheless, there is always at least 
one nonempty set Ej in the partition V . 

Now we can give the formula of a return map in E: 

Proposition 2.2. Under Hypothesis (HI) and Hypothesis (H2), the map p : E — > E which 
components p\. . . ,p n are defined in each atom E j of the partition VofY* by: 

Pi (V) = if ieJ and Pi (V) = max{a, <^ (V) (V) + ^H ji } if i $ J (13) 
is a return map in E of the model. 



Proof. Take V G E, and let J G P(I) such that V G Ej. From (6) and (7) we deduce 
that the orbit of V under the dynamics of the model satisfies: 

V(t) = ^*(V) Vt€[0,t(V)) and lim V(t) = 0* (V) (V). (14) 

itt(V) 

At time ?(V) the network enter in the firing regime and the neurons that fires are those 
of J, since V G Ej. According to (4), the potential of the neurons of J is reset and the 
potential of the other neurons suffers excitatory and inhibitory interactions from those of 
J. Together with Hypothesis (HI) it implies: 

lim VAt) = if ieJ and lim VM = max{a, <A* (V) (V) + ViT 7i } if i 4 J. 
4t(V) ttffv) jk/ 

Thus, p(V) := lim^wy) is a point of E, which is the new state of the network when 
it comes back in the sub-threshold regime. □ □ 
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An orbits {p n (V)} { n eN} of the return map gives the states of the network immediately 
after each spike (or simultaneous group of spikes). However, the entire orbit of the network 
can be reconstructed from the orbit by the return map using (14), and all the properties 
of the network can be deduced from those of the return map. In particular, the network 
has a periodic orbit if and only if the return map also has. 

The return map does not satisfy standard hypothesis of the dynamical systems theory, 
such as differentiability, or continuity in its entire domain. Actually, p is continuous in 
the interior of each set Sj of the partition V, but not necessarily in their union E. At a 
point in the boundary dT, j of a set £j, generically the return map is not continuous, since 
a small perturbation may belong to the interior of £j or to another set Sj/ and thus it 
can change the set of the firing neurons. A detailed study of these properties is given in 
Section 5.1. 

In general, it is not trivial to characterize the atoms of V because they depend strongly 
on the interactions. However, if a network is completely inhibitory, when a neuron fires, it 
does it spontaneously. This makes easier the computation of V, since it allows to replace 
J(V) by «/o(V) in the definition (12), and this last set does not depend on the interactions 
but only on the characteristics of the sub-threshold regime. For such networks, it is then 
possible to show that the boundary of V are the sets Sj such that J contains more than 
one neuron. It follows that the discontinuity points of the return map are the initial states 
leading two neurons or more to fire together spontaneously. 

3 Contraction properties of the return map 

In several mathematical studies of the global dynamics of IF neural networks, the con- 
sidered model has the property to be piecewise contractive in the whole phase space (see 
Definition 3.6). This property reflects the presence of dissipation in the networks. It is 
introduced in the model to that aim [9], or it is a consequence of the absence of excitatory 
interactions [5, 7] or of the predomimance of the inhibitory interactions [20]. In our case, 
where none of these hypothesis is assumed, it is not a property of the return map that 
holds generically in the space of the parameters of the system. Indeed, in Theorem 2, we 
prove that there exist open sets in the space of the parameters such that the return map 
is not piecewise contractive in a subregion of the phase space. This result holds for any 
metric derived from a norm and in this sense is an inherent property of the system. 

Nevertheless, we also show in Proposition 3.6 that it always (co)exists a subregion of 
the phase space where the return map is piecewise contractive. Moreover, the size of this 
region increases when the external current I ex t decreases. By Theorem 2, a contractive 
region cannot coincide with the whole phase space for any values of the interactions. 
However, we show in Theorem 3 that if the interactions are not too small, or equivalently 
the external current is not too strong, then it is possible to find a metric for which the 
return map is piecewise contracting in the whole phase space, provided the network has 
not only excitatory neurons. 

Definition 3.1. We say that a subset C of the Poincare section £ is a contractive zone 
for the return map p, if there exist a finite partition V c of C, a constant < A c < 1, and 
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a norm 




c such that 



||p(V)-p(W)|| c ^A c ||V-W 



c 



(15) 



for all V and W in a same piece of V c - If there exists a forward invariant contractive 
zone, that is p(C) C C, then p is said to be piecewise contractive in C. 

3.1 Expansion and contraction in the Poincare section 

The question we address now, is the existence of a norm || • || c such that the whole Poincare 
section E would be a contractive zone with respect to the natural partition V defined by 
the equality (12). The following theorem shows that for some networks such a norm does 
not exist. 

Theorem 2. Under the hypothesis (HI) and (H2), there exists an open region of the 
values of the interactions such that, for any norm \\ ■ \\ c , the Poincare section S is not a 
contractive zone with respect to the natural partition V . 

In order to construct a subregion of the Poincare section where the return map fails 
to be piecewise contractive, let us define for all i ^ j G / the following sets: 



Note that for any < 9 < (3 we have /3 — 6 < yj - 9) < (3-6/2 which implies that 
9/2 < c* < 9. So, a set Tj consists of the initial states of the network such that all the 
neurons have their potential equal to zero, except the neuron i, whose potential is bigger 
than the quantity c* > 9/2 and smaller than 9. Therefore, for all V £ Tj the neuron i 
reaches the threshold before the other ones, that is t(V) = i«(V), and is the neuron that 
triggers the firing regime. 

Now we state and prove the following lemma establishing a key property to prove 
Theorem 2. 

Lemma 3.2. Let i G I and suppose Tj C Sj for some J G P(I), then for all V ^ W G Tj 
such that p(V) and p(W) are bigger that a, we have 



and moreover ||p(V) — p(W) || > || V — W|| . 

Proof. Let us compute p(V). On one hand, since V G Sj, we have /Ofc(V) = for all 
k G J. On the other hand, since V G Tj, we have Vi > = for all k 7^ i which implies 
that i(V) = U(V). From the formula of the return map, it follows that for all k ^ J 



Ti := {V G S : c* < Vi < 9, V k = VA; ^ i} where c* := /3 - v / (3((3-9). 



p k (v) - p fe (w)| > w-w^ if kij, 



p fc (v) = 4 l(v) (v) + E^ = / 3 



P -Vi 



jk, 
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where the second equality is obtained applying (8) with V k = 0. The same computation 
being true for p(W) we deduce that for all k ^ J 



\p k (V) - p k (W)\ 



4 (V) (V) _ 
P(J3-9) 



(f3-Wi)(P-Vi) 



M W )( W ) 
(Wi - VI) 



0(0-9), 
> :)r .l Wi-Wi\ 



(0 



„*\2 I 



Now, ||p(V) - p(W)\\ = max{| Pi: (V) - p k (W)\, k € /} > \Vi - W t \ 
completes the proof. □ 



= \Vi-Wi\. (16) 

|V — W||, which 
□ 



Actually, the hypothesis r, C E j for some J S P(I) can be replaced by the weaker 
hypothesis: Tj n Ej is not empty and is not a singleton, for some J G P(I)- Then, the 
results of the lemma remain true for all V ^ W G I\ n E j. This weaker hypothesis always 
holds as Ti is infinite and the partition V of E is finite. This observation implies that the 
return map always exhibits expansion in some part of its phase space, independently of 
the values of the interactions (which determine the sets Ej), provided they are enough to 
ensure that p(V) and p(W) are bigger than a. 

Lemma 3.2 is stated for the distance induced by the supremum norm, and a priori, 
it may exist another norm for which the contraction property holds in the whole phase 
space, even in the Tj. Now, we are going to show that at least for some networks such 
a norm cannot exit. Examples of such networks have two excitatory neurons i / j G / 
verifying simultaneously the three following open conditions (01), (02), and (03) : 

• (01) The neurons i and j cannot be strongly excited by the sequel of the network: 

^ H ls <9-c* VsG{i,j}, 

l^s:H la >0 

• (02) A spike from i or j to any other neuron of the network produces a strong 
excitation: 

H sk >6 Vse{i,j} and k (£ 

• (03) The sum of the negative and positive interactions that i and j can receive is 
positive: 

J2His>0 VsG{i,j}. 

l^s 

For sake of simplicity we make the proof of Theorem 2 with this set of parameters, but 
other sets can be chosen. In particular, the condition (02) can be replaced by a more 
biologically realistic condition, which does not impose some interactions to be bigger than 
the threshold potential, see Remark 3.4. The important point for our proof to work, is to 
ensure that pPiTi) intersects Tj for some p and that the dilatation is conserved a least for 
some couple of points during the first p th iterations. The advantage of the proposed set of 
parameters is that it permits to show intuitively that this property is fulfilled for p = 2, 
as shown in the following. 
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Let us consider a network verifying (01) to (03) and whose state V G Tj. Then, by 
definition of Tj, the neuron i fires spontaneously at time t(V) = ii(V). At this instant, 
by condition (02), the firing of i induces the simultaneous firing of all the other neurons, 
expect j which is not sufficiently excited (condition (01)). Thus, the set of the neurons 
that fire at time t(V) is </(V) = I\ {j} and it follows that: V G and /?fc(V) = for 

all k 7^ j. Now, if i(V) is sufficiently large, that is if the initial potential Vi of the neuron 
i is sufficiently near c*, then, just before the firing regime, the potential of the neuron j is 
near c* (actually it is equal to c* is Vi = c*). Thanks to condition (03), the interactions 
of the neuron j with the network during the firing regime, help its potential to become 
larger than c*. In other words, Pj(V) £ ( c *i$) an d p(V) G Tj. We can conclude that for 
the considered network p(Ti) n Tj ^ 0. These results are stated in Lemma 3.3 and their 
rigorous proof is detailed in appendix 7.1. 

Lemma 3.3. Let i ^ j £ I. For the open region of values of the interactions that satisfy 
the conditions (01) to (03), the set Tj is a subset of T,j\^, the set Tj is a subset of 
and there exists (a,b) C (c*,0) such that for all V G Tj satisfying Vi G (a,b), we 
have p(V) G Tj. Moreover, i/W/Ver,; then p(V) / p(W). 

Proof. See the appendix 7.1. □ □ 

According to Lemma 3.3, there exist V ^ W G Tj such that p(V) ^ p(W) G Tj. 
Applying Lemma 3.2 to p(V) and /o(W) we obtain: 

\ Pi (p(V)) - Pi (p(W))\ > \ Pj (V) - Pi (W)| 

since Tj C Now, applying once again Lemma 3.2, but this time to V and W we 

obtain: 

| Pj (V)-p,(W)|>|V 4 -W 4 | 

since Tj C So we have, 

|p?(V)-p?(W)| > \V-Wi\. (17) 

Proof, of Theorem 2 Let us show that (17) is incompatible with the existence of a norm 
|| • || c such that S is a contractive zone. If we suppose such a norm exists, according to 
Definition 3.1, for the V and W of (17) we have 

||p 2 (V) - p 2 (W)|| c < A c ||p(V) - p(W)|| c < A 2 ||V - W|| c < ||V - W|| c . (18) 

Now consider the restriction of the norm || • || c to the set Gi := {0} 4_1 xMx {0} n-i , 
that is the norm || • || Cj j defined by ||U|| Cj i := ||U|| C for all U G Gi. As || • || Cj j is a norm 
in a vector space isomorphic to R, there exists p,\ > independent of U G Gi such that 
||U|| Ci j = Pi\Ui\. Therefore, for all U G Gi, we have ||U|| C = ||U|| Ci j = Pi\Ui\. As p 2 (V) 
and p 2 (W) belong to Gi (recall that p(V),p(W) G Tj C and as V and W belong 

to Ti C Gi, the inequality (18) can be written: 

||p 2 (V) - p 2 (W)|| c = p t \p 2 (V) - pf(W)\ < (jn\Vi - Wi\ = ||V - W|| c (19) 

which contradicts (17). □ □ 
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Remark 3.4. 1) If we consider the sets T itd := {V 6 £ : c* < < d, Vfc = V k / i} 
where d < 9, the condition (02) can be relaxed, without changing the important lines of 
the proof of Theorem 2. Indeed, the condition (02) ensures that when the initial state 
of the network belongs to Tj the firing of the neuron i induces the firing of any neuron 
k ^ {i, j}. But if V is in and d is near from c*, the waiting time before the firing of 
the neuron i will be large enough for the potential of any neuron k ^ i to be near from 
c*. In the limit d = c*, if V € T^d, an excitation Hik > 9 — c* from i to k is enough to 
make k fire (use (8) with Vi = c* and Vk = 0). Thus, the condition (02) can be replaced 
by the more realistic condition H s k > 5(d) for all k ^ {i,j} and s £ {hj}, where 5(-) is 
a decreasing function of d such that linid_>. c * 5(d) = 6 — c* . This former limit is always 
smaller that 9/2 and tends to when c* goes to 9 (that is when /3 goes to 9, which implies 
that the waiting time tends to infinity). 

2) On the other hand, completely different sets of parameters can be used to prove Theorem 
2 using the same sets Tj and a similar proof. Nevertheless, in order to be able to compare 
different norms, and to obtain the final contradiction (19), the set Tj must be subsets of 
Gi and the parameters must ensure the strong restriction p 2 (Ti) C\Gi ^ 0. This can be 
done with various sets of parameters, but excitatory interactions plays an important role 
to reset the potential of all the neuron excepted one. 

Remark 3.5. 1) The result of Theorem 2 may seem unexpected, since the non zero 
components of the return map are just translations applied to the time t map (j) t , which 
has a uniform negative exponent Lyapunov —7. The return map fails to be piecewise 
contractive because the waiting time i(-) to enter in the firing regime depends on initial 
state. Therefore, when the values of the return map at two different points are compared, 
we evaluate $ with different values oft, by mean of the map </>*^(-)> which is not necessarily 
contractive. In particular, </>*(')(•) is expansive in any set T,, as shown by (16). This 
property is transmitted to the return map in any intersection of the sets Tj with an atom 
of the partition V, independently from the values of the interactions. 

2) The existence of expansion in a non trivial and invariant compact part of the phase 
space is considered as a source of chaos. In general the sets Tj are not invariant. The 
role of the conditions (01) to (03), is precisely to guaranty the existence of an invariant 
subset in TiUTj. Indeed, for the networks verifying these conditions, it is possible to show 
that the invariant subset f] m>0 p~ m (Ti U Tj) is non-empty 4 . Unfortunately, it fails to be a 
chaotic attractor because it is trivial: it is just a periodic repeller (period 2). Nevertheless, 
it is a sufficient result to prove that the return map cannot be piecewise contractive in 
the whole phase space for any value of the parameters, even equipping £ with a different 
norm. On the other hand, we cannot exclude the possibility of the existence of more 
complicated regions of the phase space and of the parameters for which there exists a non 
trivial chaotic set and we hope the proof of Theorem 2 gives a strategy to search it. 

Lemma 3.2 establishes the existence of some regions of the Poincare section where the 
return map expands the distances, the sets Tj. However, there is always a subregion of £ 
which is a contractive zone, as stated by the following Proposition. 

4 The second part of the proof of Lemma 3.3 is the first step of the proof of this statement. 
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Proposition 3.6. For any c G [0,0], let us define the subset C c of the Poincare section by 

C c := {V G £ : a ^ Vi < c Vi G /}. (20) 
TTte sei Co a contractive zone with respect to the partition V . Moreover, if 

P<P + (a) with f3+{a) :=^(a + 29 + V« 2 + AO 2 ) 
then for any c G (0, c) where 

c:=f3-^P-9+y / ((3-9) 2 + A(/3-9)((3-a^, (21) 

i/ie sei C c is non empty, and is a contractive zone with respect to the partition V . 

For any value of the parameters, there is a contractive zone in the Poincare section: 
the set Cq. Moreover, if some restrictions are imposed to (3, namely 6 < (3 < (3 + (a), then 
c > 0, and there exist larger contractive zones: all the sets C c with < c < c. The nearer 
(3 is to 9, the larger is c. In particular, when /3 tends to 6, the whole Poincare section 
tends to be a contractive zone. On the other hand when /3 tends to P+(a) the quantity c 
tends to 0. 

The quantity /3+(a) is an increasing function of a and therefore 

lim p+(a) < P+(a) < P+(0), that is /3+(ct) G (9, 20) Va<0. 

It follows that there always exists some values of j3 satisfying the condition 9 < (3 < j3 + (a) , 
even for a arbitrary small. In particular if a is near to then (3 can be chosen near to 29. 
However, if f3 is larger than 29, then the only set C c which is a contractive zone is Cq. 

Recall that f3 is proportional to the external current I ext applied to each neuron. 
Therefore, the previous analysis reflects the fact that weak currents are more favorable to 
the presence of contraction (or dissipation) in the model. 

Proof, of Proposition 3.6 First, note that C c ^ if and only if c ^ 0, since any point of S 
has at least a component equal to 0. The set Co is always non empty, but for a set C c with 
< c < c to be non empty we have to ensure that c > 0. This last condition is satisfied if 
and only if 

2(3 -{(3- 9) > ^/((3-9) 2 + A(P-9)((3-a). 

Since both sides of the inequality are positive, elevating to the square each sides we obtain 
an equivalent expression, which after simplifications is: 

(3 2 - {a + 29)P + a9 < 0. 

This equation is satisfied if and only if (3 verifies: 

a , , a + 29-Va 2 + 49 2 a + 29 + y/a 2 + 46> 2 Q . . 
/M") : = g < ^ < 2 = ^ + ^' 
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As /?-(•) is an increasing function of a, it follows that P-(ct) < /5-(0) = 0, which is always 
smaller than f3 (recall that p > 9 > > a). We conclude that for all c G (0, c) the set 
C c ^0 if <P+(a). 

Now we show that for all c G [0, c) there exists A c < 1 such that for any J G P(I) we 
have: 

||p(v) -p(w)|| < A c ||v- w|| vv,weSjnc c . (22) 

Suppose V, W G Sj n C c and let i, I G J be such that V G Si and W G £/ (recall (9)). 
Let k £ I. H k £ J then by definition of /? 

|p fc (V)-p fc (W)|=0. (23) 

If k ^ J we have to consider 4 cases: 

Case 1: If p k (V) = p k (W) = a then (23) is true. 

Case 2: If p k (V) > a and p k (W) > a then, as V and W belong to the same set Sj we 
have 



/*~( v ), 



V) 



J(w) 



W) 



|pfe(V) -p*(W)| - iv fc v*;-v^ fc 

Now, V G Si and W G imply t(V) = ^(V) and t(W) = *j(W). Using (8) with we 
obtain: 



\p k (V) - p k (W)\ 



(j3-W k )(p-0) (P~V k )(P 



P-W x 



P-Vi 



P 



P-Wi 



(V k -W k ) + ^- V ^-°) (w t - Vj 



If V and W belongs to Cq then necessarily W\ = Vi = 0. If not, as W\ and Vi are the largest 
components of W and V respectively, all the components of these points are negative, 
which is impossible since they belong to S. Therefore, 



\pk(V) - Pk (W)\ 



P 



■\v k - w k \ < 



p 



If V and W belongs to C c for a c G (0, c) then 



|V-W|| if V,WgC 



(24) 



l Pfc( v) - Pk( w)\ s^\v h - w k \ + V-W-V k - m\. 



P-c 



(P - cf 



Suppose Vi < W t . As ^(V) = t(V), we have V; < V u which implies |F 4 - Wi\ < |^ - W t \, 
and 



kCv)-p*(w)| < 



/3 



P-c 

P-e 

p-c 



1 + 4— ^ ) IIV- Wll if V,WgC c . (25) 
P-c J 



Suppose W t < Vi. As i,(W) = i(W), we have W x ^ Wi, which implies |^-Wj| ^ \Vi~ W<|, 
and the inequality (25) follows as well. 
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Case 3: If Pfc(V) > a and Pfc(W) = a then 



\ Pk (V) - p k (W)\ = ^ v \V) + ^H jk -a 



< 4 (v) (v) + E^-4 (w) (w)-E^ 

< 4 (v) (v)-4 (w) (w) 

and we obtain (24) and (25) by the same calculation as in Case 2. 

Case 4: If Pfc(V) = a and /?fc(W) > a then, substituting V for W and W for V in Case 
3, we obtain (24) and (25). 

To sum up, if V, W G Co, for all k G I either (23) or (24) is true and 
\\p(y) -p(W)\\ ^ A ||V- W|| where A = ^--^ < 1. 

P 

If V, W G C c , for alike I either (23) or (25) is true and 

||/9(V)-p(W)K Ac||V-W|| where A c = ^f^- ( 1 + ^ 



/3-c V P-c 

Using the definition of c we obtain Ag = 1. The quantity A c being an increasing function 
of with c, we have A c < Ag for all c < c, which ends the proof. □ □ 



In this section we have shown that there exists some regions of the phase space where 
the return map expands the distances (the sets Tj) and other regions where it contracts 
them (the sets C c ). Moreover, for some values of the interactions, it is not possible to make 
the return map piecewise contractive in the sets Tj by changing the working norm. This 
proves that the piecewise contractive character of the return map is not a trivial property, 
and to ensure it in the whole phase space, it is necessary to impose adequate conditions 
to the parameters of the model. In the forthcoming section we propose such conditions. 



3.2 Parameters of global contraction 

Proposition 3.6 gives concrete examples of a regions of the Poincare section, denoted C c 
with c < c, where the return map is contractive. The set Cg is not a contractive zone in 
the sense of Definition 3.1 because for this set Ag = 1. Nevertheless, it contains all the 
contractive zones C c with c < c and will help the proof of the results of this section. In 
the sequel we give conditions on the parameter values (Hypothesis (H3) and (H4)) for 
which we prove that Cg has two important features. First, once an orbit enters into Cg, it 
does not leave it, furthermore, it stays in a contractive zone contained in Cg (Proposition 
3.8). Second, if at least one neuron is inhibitory, then any orbit will finally enter into Cg 
(Proposition 3.9). These two important properties of Cg allow to show that after changing 
adequately the metric in X and considering a refined partition of V, the return map 
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becomes piecewise contractive in the whole Poincare section (Theorem 3). This result 
holds under hypothesis (HI) to (H4) and if at least one of the neurons is inhibitory. The 
case for which all the neurons are excitatory, which mainly provokes the synchronization 
of the whole network, will be studied in Section 4, without assuming Hypothesis (HI) to 
(H4). 

Along this section, we suppose that the parameters verify the following two hypothesis: 

(H3) The external current I ex t is not too strong, in such a way that @ < f3+(at) and the 
interactions Hji satisfy: 

min \Hji\ > e where e := - ( - 9) 2 + 4(/3 - 9){j3 - a) - {fi - 9)) . 



(H4) We assume the Dale's principle: a neuron is either excitatory or inhibitory. In other 
words, the network does not contain mixed neurons. 

Hypothesis (H3) and (H4) define the region of the parameters for which we study the global 
dynamics of IF neural networks later on, unless otherwise specified. Hypothesis (H3) is 
an open condition relating the strength of the external current and of the resistance of the 
membrane (recall that (3 = RI e xt) with the intensity of the interactions. It first guaranties 
the existence of a contractive zone larger than Co by imposing j3 < /3+(a) (see Proposition 
3.6). On the other hand, it imposes to the interactions to have a lower bound e > (but 
no upper bound is imposed). This lower bound is an increasing function of /3 — 0. In the 
extreme case, where (3 — 9 tends to /3+(a) — 0, the lower bound tends to 9. But, if j3 — 9 
tends to then, to satisfy (H3), the interactions have to be different from 0, but can be 
arbitrarily near to 0. In other words, given fixed values of the interactions, our description 
of the dynamics of the network holds for a range of external currents such that j3 = RI ex t 
is sufficiently near to 9. Or equivalently, given a fixed value of RI e xt, this description apply 
to all the networks with sufficiently strong interactions. 

In Section 2.2 we noted that, for every V G £ such that Jo(V) contains only inhibitory 
neurons, J(V) = Jq(V). If moreover V G C g , the set Jo(V) has the following additional 
property: 

Lemma 3.7. If V G Cg and an excitatory neuron fires spontaneously, that is Jo(V) 
contains an excitatory neuron, then all the neurons fire together, that is J(V) = /. 



Proof. Suppose V G C 5 and let i G Jo(V) / I- Let us compute the neurons of Ji(V). 
Suppose k G / \ J (V). As t(V) = ^(V), by (8) we have: 



P-Vi 



^ Vj (V)=/3 
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As V G Cg, we have a ^ 14 and 14 c which implies 

W-a)(P-e) 

P-c 

4(/3-g)(/3-g) 

209 - + V(0-0) 2 + 4(/3-0)(/3-a)) 

^(/5-^) 2 + 4(/3-0)(/3-a) = i(/3 + 0)-e>0-6. 
Since Jo(V) contains an excitatory neuron, it follows that 

V) ( V ) + Yl H jk >9-e + min | ff^ | > (9, 

jeJo(v) : H jk >o 3+1 

and by definition of Ji(V), we have that /c G </i(V). We deduce that for all k G J\ </o(V) 
we have /c G Ji(V). Thus, for all fe G I either k G */o(V) or k G Ji(V). In both case 
k G J(V). □ □ 

The Lemma states that for the initial states V G Cg, it is enough that a single exci- 
tatory neuron fires to make the whole network firing simultaneously and to provoke its 
synchronization (for more details about synchronization, see Section 4). The reason is 
that, if V G Cc H Ej, the potential of the neuron i is small enough for the other neurons 
getting sufficiently near to the threshold just before i reaches it. In other words, all the 
neurons get spontaneously near to the threshold in a similar time, i.e. tj(V) ~ i(V) for 
all j G / if V G Cc- Therefore, even a small excitation (but bigger than e) is enough to 
help all the other neurons to reach the threshold in the avalanche process. Nevertheless, 
for initial states V G" C E , even if a single neuron may produce the avalanche, it does not 
necessarily makes all the neurons fire simultaneously. 

Now we apply Lemma 3.7 to prove the existence of a forward invariant contractive 
zone in the the Poincare section. We recall, that in such a case p is said to be piecewise 
contractive. 

Proposition 3.8. The set X* := p(Cg) is contained in Cc, is a contractive zone, and is 
such that /o(S*) C X*. 

Proof. We show that /)(Cg) is contained in one of the contractive zones C c of Proposition 3.6. 
Since the sets C c are compact, the same will be true for the closure X* := p(Cg). Moreover, 
as Cc contains all the sets C c , it will follow that X* C Cg and p(X*) C p(Cg) C p(Cg) = X*. 

Let V G Cc and k £ I. Since by (13) we know that a ^ pfc(V), we have only have 
to prove that /Ofe(V) ^ c for some c G [0, c). Suppose k ^ «/(V), then J(V) ^ I, and as 
V G Cc, from Lemma 3.7 we deduce that Jo(V) contains only inhibitory neurons. It implies 
that V G Xj where J := J(V) = Jo(V). Since k receives only inhibitory interactions from 
the neurons of J, we have: 

Pfc(V) = 4 (V) ( V ) + J2 H ik < ~ min \H jt \ < 9 - e. 



4 (V) ( v )^/5- 
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A straightforward computation shows that 9 — e = c and we have that pfc(V) ^ 9 — 
min \Hji\ < c. Now, if k E J(V) then pfc(V) = < c. It follows that Pfc(V) < max{0, 9 - 

mm \Hji\} < c for all k £ I. We conclude that p(V) belongs to the contractive zone C c 

with c = max{0, 9 — min □ □ 

Proposition 3.8 ensures that if an orbit of the return map falls in the contractive zone 
£*, then it stays forever in this region. The following proposition states that if the network 
contains an inhibitory neuron, then all the orbits eventually reach the contractive zone. 

Proposition 3.9. If the network contains an inhibitory neuron and i/p£N is such that 
a + pmm^i \Hji\ ^ 9, then p p+1 (E) C £*. 

Proof. Let us define for each p E N the set Z p of the points of the Poincare section that 
stay outside of Cg during p iterations: 

Z p := {V E £ : fP<y) E E \C g , 1 < j < p}. 

We are going to show that if the network contains an inhibitory neuron and p is such 
that a + pwhij^i \Hji\ ^ 9, then Z p is empty, that is p p (S) C Cc, and by Proposition 3.8, 
p p+1 (E) C E*. Afterwards, i denotes an inhibitory neuron of the network. 

First suppose that Z\ ^ and take V E Z\. By construction of the set Z\, if V E ^i, 
then p/c(V) > c for some k £ I. This neuron cannot fire at time t(V), since if it would 
then Pfe(V) = 0, which contradicts Pfc(V) > c. Therefore, 

4 (v) (v)+ E F ife <e 

J6J(V) : //.< (I 

and it follows that 

Pfe(V) = 4 (V) (V)+ ^ ff ifc + Yl H jk <9+ 

jSJ(V) : //,,. o jeJ(V) : //,, ■ 1 1 jeJ(V) : H jk <0 

If J(V) contains an inhibitory neuron then pfe(V) < 9 — min^ = c, which is a 
contradiction. Thus J(V) contains only excitatory neurons and i does not belong to 
J(V). Therefore, the component i of p(V) satisfies: 

Pi(V) = ^ (V) (V)+ £ ^ = (y. _ /3) e -7f(v) + ^ + // /; -, \ ) . mi,, //,-,• . 

jeJ(v) jeJ(V) J ^ 

So, we have proved that if V E Z\ then Pi(V) > Vj + min^ |-Hji|- 

If we suppose now that Z p ^ for a p > 1 and if we take V E Z p , then p J (V) E -Zi 
for all j E {0, . . . ,p — 1}. By induction it follows that 

8 > p?(V) = ftCpP" 1 ^)) > pT^V) + min |^| 

J 7^ 

> pf" 2 (V) + 2min > • • • > Vi +pmin 
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As Vi ^ a, we have just obtained that a + pmin^ \Hji\ < 9 if Z p ^ 0. Thus, if 
a +pminj^j |-H"ji| ^ 9 the set Z p is empty and /^(S) C Cg. □ □ 

Remark 3.10. Proposition 3.9 allows to obtain an estimation of the transient time ttrans 
necessary for all the orbits of the network to enter into the contractive zone E* . Let po is 
the smallest integer such that a+po min^ \Hjj\ ^ 9, that is po := \(9 — a)/ min^j l-Hjill • 
Then any orbit of the network, with an initial condition in the Poincare section S, enters 
into the contractive zone after po returns in E. Now recall that the return time (or the 
inter-spike interval) is the necessary time for the network to enter in the firing regime from 
its initial state V S E, that is i(V). A straightforward computation using the equation 
(6) of the flow, shows that an upper bound of t(V) for V £ E is T := log (/?/(/? — 9)). 
Therefore, we deduce the following upper bound for ttrans'- 

It follows that the stronger the interactions are, the shorter is the transient time to enter 
into the contractive zone. On the other hand, if (3 — 9 is small then the condition (H3) can 
permit very small interactions. In such a case, the upper bound does not prevent from 
very long transients. Nevertheless, the transient time remains always finite. 

Corollary 3.11. // there exists V G E such that fP(V) £ E* for all p <E N then the 
network contains only excitatory neurons. 

To close this section about the contraction properties of (the return map of) IF neural 
networks we state the following Theorem 3. It proves that if the parameters of a network 
satisfy the hypothesis (H3) and (H4) then its return map is piecewise contractive in the 
whole Poincare section. 

Theorem 3. Under the hypothesis (HI), (H2), (H3) and (H4), if at least one neuron is 
inhibitory, then there exists an adapted metric and a partition V' of the Poincare section 
E such that the return map p is piecewise contractive in E with respect to V' . 

The proof of the theorem is given appendix 7.2. It follows from Proposition 3.8 and 
Proposition 3.9 which allow to prove that p is "eventually piecewise contractive" (see 
Lemma 7.1 in appendix 7.2). This is a generalization for piecewise continuous maps of the 
definition of eventually contractive maps (see for instance Definition 2.6.11 in [16]). Then, 
the classical arguments to prove the existence of an adapted metric can be reproduced for 
piecewise continuous maps. 

In the sequel of the paper we will based our study on Proposition 3.8 and Proposition 
3.9. They show that for the region of parameters defined by (H3) and (H4), the Poincare 
section contains two important regions: the contractive zone (E*), which is a forward 
invariant set of the return map, and the set of the points whose orbit never fall in the 
contractive zone. This last set can be non-empty only for networks composed exclusively 
of excitatory neurons (cf Corollary 3.11). We study these networks in the Section 4. In the 
case of the networks containing inhibitory neurons, all the orbits drop into the contractive 
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zone after a finite time (Proposition 3.9). The study of the asymptotic dynamics reduces 
then to the analysis of the dynamics of the return map in the contractive zone. This is 
the purpose of Section 5. 



4 Synchronization 



In this section we prove the part (1) of Theorem 1 stating sufficient conditions for the 
global synchronization of a network. 

Definition 4.1. We say that an orbit {V(t)} tG jg+ is a synchronized orbit of the network, 
if Vi(t) = Vj(t) for all i,j G I and t G M + . We say that the network globally synchronizes, 
if for any initial state V(0) there exists to £ ^ + such that {W(i) = V(i + io)}teiR + ^ s a 
synchronized orbit. 



Up to a time translation, a network admits only one synchronized orbits and this orbit 
is periodic. Indeed, suppose a synchronized orbit intersects the Poincare section at a 
point V G X. Since V G X, one of its component is equal to zero, and since V belongs 
to a synchronized orbit, all its components are equal. It follows that any synchronized 
orbit intersects X at the same point, which is the origin of M n . Moreover, as in the 
sub-threshold regime all the neurons obey to the same the differential equation (2), if 
V = 0, then all the neurons reach the threshold spontaneously at the same time and their 
potential is reset to at the same time. In other word p(0) = and therefore the orbits 
of is a periodic orbit of the network. 

Latter on, we will call V G X a state of eventual synchronization, if there exists I G N 
such that p l (V) = 0. Note that a network globally synchronizes if and only if all the 
points of the Poincare section are states of eventual synchronization. 

Theorem 4. Under hypothesis (HI), if the network is exclusively composed of excitatory 
neurons, that is min Hji > 0, and if the number n of neurons satisfies 



n ^ 



min Hji 



(26) 



where \x\ denotes the first integer larger or equal to x, then the network globally synchro- 
nizes. Moreover, the transitory time before the global synchronization of the network is 
not larger than 
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In networks of excitatory neurons, the synchronization state is persistent. That is to 
say, the network recovers its synchronization in a finite time, if a small perturbation is 
applied to the orbit of the synchronized state G X. Precisely, the flow (p t that solves 
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the differential equation (2) depends continuously on the initial state V for fixed t > 0, 
provided that in the interval (0, t) no neuron fires. Therefore, there exists 6* > such 
that if || V - 1 1 < 5* then ||0*(V) - 0*(O)|| < m, where m := minHji. If i is the first 

neuron to reach the threshold potential from the perturbed state V at time t(V), the 
potential of all the other neurons belongs to (0 — m, 0] at this instant. Since the minimum 
interaction with i is of magnitude m, the firing of i induces the firing of the other neurons. 
The interactions being instantaneous, the potential of i and of the other neurons are reset 
to simultaneously and p(V) = 0. The same argument works as well to prove that the 
global synchronization is stochastically stable. If a synchronized orbit suffers a stochastic 
perturbation such that, at the instant when a first neuron reaches the threshold, the 
potential of the other neurons is sufficiently near the threshold, then this orbit goes back 
to the Poincare section at the synchronized state. 

Proof, of Theorem J^: As the network does not contain inhibitory neurons, a time t+ 
from which the potential of all the neurons is larger or equal to zero exists. This time is 
smaller than the necessary time for a neuron, with an initial potential equal to a, to reach 
the threshold spontaneously. That is to say, 

t + < - In ' 



7 \P- 

recall (6). Besides, after t+, it is in the set 

£+ := {V G S : VJ > Vi G 1} 

that the orbits of the network intersect the Poincare section. Therefore, to prove the 
global synchronization of the network, it is enough to do it for the initial states in S + . 
Thus, we are going to show that there exists a natural number I such that p (V) = for 
all V G £+. 



Let us denote 



m := minHji > and p :- 



m 

We state and prove two claims to achieve the proof of the theorem. 



(27) 



Claim 1: For any initial state V of the network in S + , each neuron fires at least once 
before the p th return of the orbit of V in S + . In brief, the set J P (V) defined by 

p-i 

JP(V) := |J J(^( V )) 
7=0 

is equal to / for any V G S + . 

Let i G I. Let us show that if i £ J P_1 (V), that is i £ J(pi(V)) for all j G {0, . . . ,p — 2}, 
then i G J(/> P ~ 1 (V)). If i ^ J P ~ 1 (V), then, by definition of p, for any j G {1, . . . ,p — 1} 
we have: 

pj(V) = ^" 1(V) V _1 (V)) + E ff «> Pt\v)+m, 

keJifp- 1 ^)) 
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where the inequality is obtained using that j (V) > Vt for all V £ £ and i £ J, and 
the fact that all the interactions are excitatory. By induction it follows that /of _1 (V) > 
Vi + {p — l)m. We deduce that 

4 (pP ~ 1(V) V _1 (V)) + Yl H ^> ^ _1 ( V ) +m>Vi+pm^pm^e, 

keJipP- 1 ^)) 

which implies that i £ J(p p_1 (V)) and proves the claim. 

Claim 2: For any initial state of the network V £ £ + , there exists jo £ {0, . . . ,p — 1} 
such that the number of neurons that fire simultaneously at time £(W), where W is the 
j* return of the orbit of V in £ + , is larger than 9/m. In brief, for all V £ £ + , there 
exists j G {0, . . . ,p - 1} such that #J(p J '°(V)) ^ 0/m. 

Let V £ £+ and j be such that #J(p*>(V)) ^ #J(p*'( v )) for all j £ {0, . . . ,p - 1}. 
According to Claim 1, we have n = #J P (V). Therefore, 

p-i 

n = #J^(V)^^#J(^'(V)) ^p#J(^°(V)). 

5=0 

Using (26) we prove Claim 2: 

#J(p*>(V))>- = 




The quotient 0/m is the number of times that the minimum synaptic weight m has 
to be added to the potential of a neuron with the minimal potential to reach 8. Claim 
2 shows that at some finite instant, the number of neurons that fire simultaneously is at 
least as large as this quotient. Thus, the firing of these neurons necessarily induces the 
firing of any other, at the same instant. Indeed, in the mathematical notation, using Claim 
2 we obtain 

4 (pJ0(V V°(V))+ y H ki > p>o(V) + m-^e, Vie I, V£S+. 

* 777 

kdJ{fy>0 (V)) 

Therefore, J(p*°(V)) = I and p l (V) = with l=j + l. 

The global synchronization of the network need at most a time t + to enters in the set 
S + and jo + 1 ^ p iterates of the return map. Thus, the transitory regime does not exceed 
the time 

□ □ 
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Theorem 4 shows that a network of excitatory neurons globally synchronizes if the 
number of neurons n is sufficiently large. This theorem only requires the hypothesis (HI), 
to ensures the obvious fact that no neuron has an infinitely negative potential. As all the 
synapses are supposed excitatory, the hypothesis (H2) and (H4) are not needed. Likewise, 
the hypothesis (H3) of the existence of a lower bound e > for the interactions is not 
required. In particular, positive but arbitrarily small interactions may affect the length 
of the transitory regime, but do not prevent the network from globally synchronizing, 
provided n is sufficiently large. Finally, if the number of neurons does not satisfies (26) 
the global synchronization may not occur. We illustrate this statement with a simple 
example involving two neurons and constant interactions. 

Proposition 4.2. Let I = {1,2} and H 12 = H 21 = H G (0,(9). The orbit {p k (V)}keN of 
the point 



1 



V = (/3-x,0) where x := - (y ' H 2 + 4/3(/3 - 6) - H 
is not synchronized. It is a period two orbit, the points of which are (f3—x, 0) and (0,/3 — x). 

Proof. A straightforward computation shows that (3 — x < 9 if and only if H < 9, and 
f3 — x > if and only if H > —9. Thus, the condition H G (0,9) ensures that V G S and 
not equal to (0,0). Now, let us show that p(V) = (0,/3 — x). As V\ > = V 2 , the neuron 
1 fires spontaneously at time t(V) = ii(V) and Jo(V) = {1}. Using (8) with V 2 = 0, we 
obtain 

4<v» (v)+if = ,_w^) +ff= ,_w^) +if= ,_ x . 

(p - Vi) x 

Since /3 — x < 9, we deduce that the neuron 1 does not induce the firing of the neuron 2, 
and Ji(V) = J (V). Thus J(V) = {1}, and 

Pl (V) = and p 2 (V) = 02 {V) (V) + H = - x, 

which proves that p(V) = (0,/3 — x). Substituting V\ by p 2 (V) and V 2 by pi(V) in the 
proof of p(V) = (0,/3 - x), we obtain p 2 {V) = (/3 -x,0) = V □ □ 

The result of Proposition 4.2 can be easily extended to an arbitrary large number of 
neurons. For example, in a network with 2k = n neurons, with equal synaptic weight H/k 
where H G (0, 9), any initial state such that half of the neurons have their potential equal 
to (/3 — x), and the other half have their potential equal to 0, is a periodic point of period 
2. 

When Hypothesis (H3) is assumed, and thus the interactions are bounded bellow by a 
positive number (which tends to zero when (f3 — 9) tends to zero), the global synchroniza- 
tion is not sure, since the hypothesis of Proposition 4.2 can be satisfied as well. However, 
according to Lemma 3.7, there is always some initial states for which the network syn- 
chornizes. 

Proposition 4.3. Under Hypothesis (HI) and (H3) , if the network is exclusively composed 
of excitatory neurons, and if its orbit visits the contractive zone £*, then the network 
synchronizes, independently of its size. 
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Proof. Suppose the orbit of the network visits X* at a point V. Since X* C Cg and / 
is only composed of excitatory neurons, the hypothesis of Lemma 3.7 are satisfied. We 
deduce that J(V) = I, and so p(V) = 0. □ □ 



Now, if the network has also inhibitory neurons, any orbit visits X* after a finite 
transitory regime, see Proposition 3.9. Therefore, if the network does not synchronizes, it 
is because the excitatory neurons stop to fire after a finite time. We prove rigorously this 
results in what follows. 

Definition 4.4. We say that V G £ is a state of eventual death of the neuron i, if there 
exists p£N such that i ^ J(p J (V)) for all j ^ p. 

In other words, a state of eventual death of a neuron is a state such that the neuron 
stops to emit spikes after a certain time. Therefore, we define a state of the (continuous 
time) model of eventual death as a state whose orbit intersects the Poincare section in a 
state of eventual death. 

Proposition 4.5. Under the hypothesis (HI), (H2), (H3) and (H4), if the network is 
composed of excitatory and inhibitory neurons, then the states of the network are either 
states of eventual synchronization or states of eventual death of all the excitatory neurons. 

Proof. Let i be an excitatory neuron and V G S. By Proposition 3.9 we can assume 
V £ S* without loss of generality. We have, either i ^ J(/> ? (V)) for all j € N or there 
exists j E N such that i £ J( / o J (V)). In the first case V is a state of eventual death 
of the neuron i. In the second case, by Proposition 3.8 it follows p J (V) G T,* for all 
j E N, and then we can apply Lemma 3.7 to deduce that J(p^(V)) = /. This implies 



5 Asymptotic dynamics of networks with inhibitory neu- 



In the previous section we studied the dynamics of networks composed exclusively of 
excitatory neurons. Now we focus on networks containing at least one inhibitory neuron. 
Along this section, we assume Hypothesis (HI), (H2), (H3) and (H4) on the parameter 
values, and that the set I~ of inhibitory neurons is non empty. 

Section 5.1 is a preliminary section where a more precise characterization of the return 
map in the contractive zone X* is given. We study its continuity pieces and show that it 
satisfies a general definition of piecewise contracting maps. In Section 5.2, we introduce 
the concepts of stable set and sensitive set. Then, in Section 5.3 we give and we comment 
the principal results about the asymptotic dynamics of the return map in both of these 
sets. It contains in particular Theorem 5, which is a more detailed version of the part 2) 
of Theorem 1, about the dynamics in the stable set. Finally, the ending Section 5.4 is the 
proof of a proposition contained in Section 5.3. 




□ 



□ 
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5.1 Continuity pieces of the return map in the contractive zone E*. 

In Proposition 3.9 we have shown that any orbit of a network containing inhibitory neurons 
finally drops into the forward invariant contractive zone £*. Then, it is not restrictive to 
consider this space as our new phase space 5 . In Section 2.2, we introduced the partition 
V of the Poincare section defined by (12). When restricting our the phase space to £*, 
this partition becomes 

V* : = {Sj} Je p(/) where £} := EjflS* V J G P(J). 

As before, if the initial state of the network is V G Sj, then, when the network enters in 
the firing regime at time t(V), the neurons that fire are exactly those of the set J. As 
a starting point to the study of the asymptotic dynamics of neural networks containing 
inhibitory neurons, we give here a detailed description of the partition V*. It will allow 
to show that the return map satisfies a general definition of piecewise contractive map. 

First of all, some atoms of V* are empty. Indeed, by Lemma 3.7, if J contains excitatory 
neurons and J ^ I, then S j = 0. As a consequence, the possibly nonempty sets of V* are: 
the set £} of the initial states such that in the firing regime all the neurons fires, and the 
sets T,j of the initial states such that in the firing regime only some inhibitory neurons 
fire. It follows that 

s *= U s jU s ^ 

JeP(i-) 

where I~ C / is the set of the inhibitory neurons and P(I~) denotes the set of all the 
nonempty subsets of I~ . 

Each set £} admits an explicit formulation which is useful to study the topological 
properties of V* . 

Let J E P and suppose the initial state of the network is V E Sj. Since the firing 
of an inhibitory neuron cannot lead another neuron to fire, if all the neurons of J fire, 
it is because they all reach the threshold spontaneously at the same time t(V). In other 
words, U(V) = i(V) for all i G J and ifc(V) > i(V) for all k J. The initial potential 
of all the neurons of J is thus the same and it is larger than the potential of the other 
neurons. So, we can conclude that 

£*={Vg£* : V i = V j >V k Vt,j G JandVfcg" J} VJeP(r). (28) 

Now let J = I and and suppose the initial state of the network is V G £}. Then, 
either all the neurons reach spontaneously the threshold at the same time, or at least one 
excitatory neuron reaches the threshold before the others and induces the firing of all the 
others by avalanche. In both cases ti(V) = i(V) for some i in the set I + of the excitatory 
neurons. So, we can conclude that 

£} = {Ve£* : max^Vfc V A; G I}. (29) 
From now on, p will denote the return map restricted to E c . 
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Let us study the topological properties of the sets Ej. We consider the relative topology 
induced by M. n in E. 

In the case where J contains only one neuron, then it is an inhibitory neuron, and 
according to (28) 

= {V £ E* : Vi > V k Vk^i} Vi £ I~ . 
A set is open, and its topological boundary, that we denote SE^p is the set 

8E* {{} = {V € E* : Vi^Vk V k £ I and 3 ife 7^ i : V t = V k }. (30) 

Suppose now that J C P(I~) contains two or more neurons, and let V £ Ej. From 
(28) it follows that Vi ^ V k for alii £ J and k £ I, and Vi = Vj for all i,j £ J. Therefore, 
V belongs to the intersection of the boundary of the sets E^ such that i £ J. We deduce 
that 

E} C (J SE| i} VJ C P{r) such that #J > 2. (31) 

«eJ 

o 

Finally, let us study the set EJ. According to (29), its interior EJ is 

£°J = {V£E* : maxVi>V k V£;£/}, 

and its boundary is the subset of EJ defined by 

<9EJ = {V £ E* : m&xVi >V k V k £ I and 3 j £ I~ : M = maxVS}. (32) 

ie/+ i£/+ 

If V £ 9EJ, then there exists j £ I~ such that K- ^ for all k £ I, with equality for a 
k £ I + and thus different of j. In other words V £ ^EJ^ for a j £ I~ . It follows that 

<9EJ c (J SEf.p 

16/- 

To sum up, the previous analysis shows that E* can be decomposed as the union of 
#/ _ + 2 pairwise disjoint sets: the open sets EJo (one for each inhibitory neuron i £ 
the interior of EJ, and the closed set with empty interior dV* . This last set is the union of 
<9EJ with the sets E j such that J contains only inhibitory neurons and # J ^ 2. Moreover, 
it coincides with the union of the topological boundaries of the open sets EJo. So, we 
have 

S* = |J E| i} (J E°J J dP* where 0P* := (J 0Ef i} . (33) 
Each set of the type EJ^ consists of the initial states of the network for which, in the 

o 

firing regime, only the inhibitory neuron i fires. The set EJ are the initial states of 
the networks for which only excitatory neurons (one or several) reach spontaneously the 
threshold. According to Lemma 3.7, the firing of these excitatory neurons induces the 
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synchronization of the network. Finally, for the initial states V G &P* , at least two 
neurons reach the threshold spontaneously and at least one is inhibitory. If they are all 
inhibitory, then only these neurons fire (it corresponds to the case where V G Ej, with 
#J > 1), but if one of them is excitatory, its firing induces the synchronization of the 
network (it corresponds to the case where V G 

o 

The return map is continuous in and in any 5]{jp because each of these sets is 
open, and contained in the interior of a set £j where p is continuous (see (13)). So, the 
boundary set dV* contains all the discontinuity points of the return map. Let us give an 
intuitive idea explaining why those discontinuities appear. For an initial state V G dV* 
at least two neurons fire in the firing regime, say i G I~ and j G /. But, there exists an 
arbitrarily small perturbation W of V that belongs to SI,, i.e. such that only the neuron 
i fires in the firing regime. This implies the existence of a gap between /o(V) and /o(W), 
since Pj(V) = and Pj(W) ^ 0, except for a very specifics value of Hij. The following 
lemma makes rigorous this intuitive idea. 

Lemma 5.1. // V G &P* , then there exists a sequence {U m } m gN of points of S* such 
that lim U m = V and lim \\p{V m ) - p(V)|| ^ p where 

m— ¥oo m— ¥oo 

p := mm{\a\, min \ + 8\}. (34) 



Proof. Let V G dV* and i £ I such that V G dT,*^. By definition of boundary, there is 
a sequence {U m } m£ N of points of El, such that lim U m = V. For all k ^ i, we have 

hm p fc (U ) = hm maxja, (3 V H ik \ 

m— >oo m— >oo h — (J. 

= maxja, /3 — h H ik ). 

P 'i 



On the other hand, if V G dT,^, it belongs to a set Sj such that i G J and #J ^ 2 
(possibly J = I). Therefore, there is j 7^ i in J such that V{ = Vj and it follows that 
lim pj(U m ) = max{a, + 6}. As j £ J and V G Sj, we have Pj(V) = 0, and we 

m— >oo 

obtain that 



lim \\p{V) - p(U m )|| ^ lim | Pj (V) - Pj (U m )\ = | max{a, + 9}\ 

m— >oo m— >oo 

which leads to the desired inequality. □ □ 



To conclude this section we give a general definition of a piecewise contractive map 
and we show that the return map fulfill this definition. 

Definition 5.2. (Piecewise contractive map) A map p, from a compact set X* C M. n to 
itself, is said to be piecewise contractive if it satisfies the following three conditions: 
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1) There exists a finite family £r i, Sm, . . . , E| p j of pairwise disjoint open sets such that 

i=0 

2) There exists a constant A < 1 such that for all i £ {0, 1, . . . ,p} 

||p(V) - p(W)|| ^ A||V - W|| VV, W £ E^ } . 

3) The map p has a discontinuity jump larger than a constant > in the borders SE^ 

of a the sets E?.-, . 

W 

Under the hypothesis (HI), (H2), (H3) and (H4), and the additional generic hypothesis 

mm\Hij + 6»|/0, 

which stipulates that the smallest inhibitory interaction is different from —9, the return 
map of the network is piecewise contractive. 

First, by Proposition 3.8, the set E* is compact and p(E*) C E*. Second, if we denote 
the interior of EJ and p the number of inhibitory neurons, the decomposition (33) of 
E* shows that the condition 1) is satisfied. Third, the condition 2) is also satisfied because 
E* is a contractive zone with respect to the partition V, and thus it is also a contractive 
zone with respect to the partition V* . Finally, the Lemma 5.1 shows that 3) is true for 
[i := min{|a|, min \Hij + 9\}, since a < by Hypothesis (HI) and min + 9\ ^ 0. 

The results of the sequel of this section apply to any abstract piecewise contractive 
map satisfying Definition 5.2. So, they apply in particular to the return map under the 
hypothesis mentioned above. To simplify the notations, and to fit with those of Definition 
5.2, we will denote S | j the interior of E}. It does not mean that a new neuron is 
introduced in the network, it rather recall that if V £ ^{o} then p(V) = 0. Also, Iq will 
denote the set {0, 1, ... , #J - }. 

5.2 The stable and the sensitive sets. 

In order to study the asymptotic dynamics of the return map, we divide the contractive 
zone E* in two complementary sets: the stable set S and the sensitive set C = E* \ S. 

Definition 5.3. (Stable set) A point V £ E* is stable, if for all v > there exists 5 > 
such that for all p £ N: 

if ||/(V) - W|| < 5 then ||p fc (/(V)) - p k (W)\\ < v Vfe^l. (35) 

We call stable set and denote S the set of all the stable points. 
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If V is a stable point, then any sufficiently small perturbation of V, or of a point of 
its orbit, has an orbit which remains near the orbit of V. For instance, if the initial state 
of a network is stable, one can expect that a small perturbation may modify slightly and 
temporary the inter-spike intervals, but would not change the firing neurons. 

Definition 5.4. (Sensitive set) A point V £ £* is sensitive, if there exists v > such 
that for all 5 > there are p£N and W £ S c satisfying: 

||/(V) - W|| < S and ||/(/(V)) - p fc (W)|| > v for some jfe > 1. 

We call sensitive set and denote C, the set of all the sensitive points. 

The sensitive set is the set of the points that are not stable. For a network in a sensitive 
state, there exit arbitrarily small perturbations that produce a consequent change of its 
time evolution. Typically, such perturbations modify the firing neurons at an instant of 
its evolution. 

Lemma 5.5. The stable set S is forward invariant, i.e p(S) C S, and the sensitive set C 
is backward invariant, i.e p~ l (C) C C. 

Proof. Let us prove that p(S) C S. Take V £ S. Then for all v > there exists 5 > 
such that for all p ^ 1 

if Hp^CpCV)) - W|| < S then HAp^pCV))) - p fe (W)|| < v VJfe > 1. 

The last assertion is the definition of stable point applied to p(V). Therefore p(S) C 5. 
As C is the complement in E* of 5, and p(S) C S we have p~ l (C) C C. □ □ 

Lemma 5.5 proves that if a network is initially in a stable state then it is forever stable. 
If it is in a sensitive state, its past states are sensitive, but its future states can be stable. 

Now, we give a useful characterization of the stable set: 

Lemma 5.6. Let us denote d the distance induced by the norm \\ ■ \\, that is d(V,W) = 
|| V — W|| for all V and W in £*. For all n > 0, let be the set of the stable points 
whose orbit is at a distance larger than rj of dV* : 

S V :={V £ S : d{pP{\),dV*)^n £ N} Vr/ > 

then, 

S = [J S v . (36) 
n>o 

Proof. By definition, C S for any rj > 0. Now, let V £ S and suppose by contradiction 
that V ^ S v for all r] > 0. Let 5 > and fi be the discontinuity jump of p in dV* defined 
in (34). As V is a stable point, there exits < 5q < 5 such that for all p £ N 

if ||/(V)-U||<5 then ||p(/(V)) - p(U)|| < \. 
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As V ^ S$ /2, there exist po and W € &P* such that 

||pP° ( V)_ W ||<!<*. 
By Lemma 5.1, there exist U G S* such that 

||W-U||<| and ||p(W)-p(U)||>|. 
For this U, we have \\pP°(V) - U|| < ^(V) - W|| + ||W - U|| < S . Thus, 
||p(^(V)) - p(W)\\ > \\\p(W) - p(U)|| - ||p(^(V)) - p(U)||| > 



M _ M 
2 4 
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To sum up, we have shown the existence of a v := p/A such that for an arbitrary 5 > 0, 
there exists po and W such that 

||pPo(v)-W|| <<5 and ||p(/°(V)) -p(W)|| ^ v. 

It follows that V belongs to the sensitive set, which is a contradiction. We conclude that 
for all V G 5 there exists r\ > such that VgS,. □ □ 

Note that each set is forward invariant and does not contain point of &P* . In other 
words, 

p(S v )cSr, and 5„c|JSj i} Vt?>0. (37) 

iel 

and by (36) the same relations are true for S. It follows in particular that p is continuous 
in any and in S. Also dV* is a subset of the sensitive set. The relations (37) show 
that if the initial state of the network is stable, then either it get synchronized, if its 
orbit visit ^{o}> or only inhibitory neurons fire and never at the same time. The situation 
where various inhibitory neurons fire simultaneously occurs only when the network is in a 
sensitive state. 

5.3 Principal results on the asymptotic dynamics 

In this subsection we prove Theorem 5 which states that the limit sets attracting the 
stable points is only composed of limit cycles. The number of limits cycle can be finite or 
infinite, but it is always countable. The proof essentially relies on the contraction property 
of the return map. Since the map is not continuous, it is not possible to apply directly 
a classic fixed point theorem for contractive maps. Nevertheless, we give a generalization 
of the Banach fixed point theorem for piecewise contractive maps. It states the existence 
of periodic orbits - maybe of periods different from one and not necessarily unique - that 
attract all the stable points. 

Definition 5.7. (uj -limit set) The o;-limit set w(V) of a point V 6 S* is the set of the 
limit points of the future orbit of V, that is: 

w(V) = {W£E* : 3{p fc } fceN : lim p k = +oo and lim p? k (V) = W}. 

k— too k— too 
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For a set A C £*, we denote w(^4) the union of all the w- limit sets of the points of A. 
That is, 

u(A) := (J W (V). 

VGA 

In other words, W belongs to the w-limit set of V if there exists a subsequence of the 
orbit of V which converges to W. As the phase space S* is compact, the u;-limit set of 
any point is nonempty. Intuitively, the w-limit set of V is the set of the points of S* for 
which there exists an arbitrarily small neighborhood which is always visited by the orbit 
of V. In this sense, the points of w(V) are those which attract the orbit of V. The set 
w(V) is forward invariant if p is continuous in w(V), which is not necessarily the case for 
any V. Nevertheless, the w-limit set is the same for all the points of a same orbit. 

Definition 5.8. (Limit cycle) A set L C S* is a limit cycle, if it is a periodic orbit whose 
basin of attraction 

B(L) = {W G S* : w(W) = L] 
contains an open neighborhood of L. 

Now we state the two important results of this section: 

Proposition 5.9. For any rj > such that S v ^ 0, the set contains only a finite 
number N(rj) of limit cycles, and any point of belongs to the basin of attraction of one 
of these limit cycles. In other words, for all rj > 

N( V ) 

u ( s ri) = U L *> 

i=l 

where each set Li is a limit cycle included in Syj . 

We postpone the proof of the proposition to Section 5.4. This proposition allow us 
to deduce the following theorem which is a more detailed statement of the part 2) of 
Theorem 1. As well as Proposition 5.9, this theorem is true for any piecewise contractive 
map satisfying Definition 5.2. 

Theorem 5. If S 7^ 0, any stable point belongs to the basin of attraction of a limit cycle 
contained in the stable set. The number of these limit cycles is countable. In other words, 

N 

u(S) = [jL i , 

where each set Li is a limit cycle included in S. Moreover, the number N of limit cycles 
is finite if d(u(S),dV) > and it is infinite, but countable, if d(u)(S),dV) = 0. 

Proof. By Lemma 5.6 any stable point V belongs to a for some rj > 0. Therefore, by 
Proposition 5.9, it belongs to the basin of attraction of a limit cycle in S v C S, that is 
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w(V) is a limit cycle contained in S. As for all rj > rj we have S rj > C S 1 ^ we can rewrite 
(36) as 

S = I J Si where I := max d(V,dV*). 

fcGN 

Since for each k £ N the set w(<S//fc) is a finite union of limit cycles and 5 is a countable 
union of the sets S^, it follows that uj(S) is a countable union of limit cycles. 

If d(u(S),dV*) > 0, then there exists rj > such that d(u(S),dV*) ^ 77. Since the 
points of uj(S) are stable, the return map is continuous in uj(S) and therefore uj(S) is 
invariant. It follows that the orbit of any point of oo(S) remains at a distance larger than 
rj of dV* . In other words, uj(S) C S v . By Proposition 5.9 it implies that u(uj(S)) is a finite 
union of limit cycles. But as uj(S) contains only periodic points we have u)(w(S)) = oj(S). 
This show that if d(u>(S), dV*) > then u>(S) is a finite union of limit cycle. 

Now suppose d(uj(S),dP*) = 0. Then, either uj(S) fl &P* / 0, or there exits an infinite 
sequence of different points of uj(S) which converges to a point of dV* . The first option is 
impossible since uj(S) C S and dV* is a subset of the sensitive set. Therefore, the second 
option holds and co(S) is infinite. This ends the proof, since in the other hand, we know 
that is it countable. □ □ 



Now we detail the consequences of the previous results on the dynamics of IF neural 
networks. 

Theorem 5 states that if the initial state V of a network is stable (i.e. V G S) then, 
when time tends to infinity, the network tends to fire periodically, since it is attracted by 
a limit cycle. If an excitatory neurons fires, this limit cycle is a synchronized orbit. But 
if no excitatory neuron fires, then the asymptotic firing patterns of each neuron present a 
common period but they are not synchronized (recall (37), two inhibitory neurons cannot 
fire at the same time). According to the initial stable state of the network, the attracting 
limit cycle can change. The stable set contains only a countable number of limit cycles 
and certainly, for most values of the parameters, this number is finite. However, it can 
also be infinite. 

The situation described above does not prevent the stable dynamics of the network 
from exhibiting a behavior which seems chaotic, in a wide sense of the term. By definition 
of the stable set, any sufficiently small perturbation is damped and does not modify the 
asymptotic periodic pattern of the network. Nevertheless, the size of such perturbation 
depends on the set S v to which the initial state of the network belongs. If 77 is large, then 
large perturbations are allowed. But if ij is small, then the orbit of V can get near to the 
discontinuity set dV* , or more generally, near to a sensitive point, in such a case some 
small perturbations (but non arbitrarily small) can change significantly the behavior of the 
network. The most probable effect is a change of the limit cycle attracting the network. 
Also, the network enters into a transitory regime before reaching this new limit cycle. 

Moreover, the transitory time before the network gets near to a limit cycle and the 
period of this limit cycle cannot decrease when r\ decreases (see Remark 5.12). In other 
words, the initial stable states whose orbits get the closer to the sensitive points have 
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the larger transitory times. Besides, the limit cycles attracting them have the largest 
periods. It follows that those limit cycles may never be observed during a finite time of 
experimentation, since the network is in a transient regime and/or it tends to a limit cycle 
of very large period. This phenomenon most probably occurs if the distance between uj(S) 
and dV* is equal to zero. In such a case u>(S) contains an infinite number of limit cycles, 
and for any given number 5 > 0, there is an infinity of limit cycles at a distance smaller 
than 5 of dV* . Thus, most of the initial states of the network have an orbit which is 
attracted by one of these limit cycles of large period. Furthermore, if a small perturbation 
is applied repeatedly to one of these orbits, for example by rounding errors in numerical 
simulations or in the presence of noise, it can maintain the orbit in the same region, but 
change many times the limit cycles it is attracted by. 

Theorem 5 and Proposition 5.9 are results about the asymptotic dynamics of the stable 
set. However, Lemma 5.6 allows us to make some comments about the dynamics of the 
complementary set, namely the sensitive set. This lemma proves that any stable point 
belongs to a set for some r] > 0. Therefore, all the points of the orbit of a stable point 

V are at a distance larger than 77 (V) > of &P* . It follows that the sensitive set consists 
of the points whose orbit is arbitrarily near to dV* . These points are those of &P* and of 
all its pre-images |J p~ k (dV*), as well as the points whose w-limit set contains a point 

of dV*. Formally, 

C= (J P ~ k (dV*)[jC where C := {V G S* : w(V) n dV * + 0}. 

km 

The points of C that are not in C have an orbit which is eventually stable and Theorem 
5 applies for them after a transitory time. The set C is invariant, and for any initial state 

V in this set, there exit arbitrarily small perturbations that produce a large deviation 
in its orbit. The invariance of C and its sensitivity to arbitrary small perturbations are 
ingredients of the concept of chaos. However, they are not enough to ensure the presence 
of chaos from a strict mathematical point of view. In particular, the existence of piecewise 
contractive maps exhibiting chaotic attractors is a widely open question. Also, the exact 
nature of the possible attractors of C has been few documented. We can nevertheless 
mention [8], where this question is investigated for piecewise affine contractive maps. In 
this paper, it is shown that the attractor of C can have any type of cardinality (finite, 
countable infinite and uncountable). In particular, the most complex found attractor is a 
transitive union of a Cantor set and an infinite countable set, which does not contain any 
periodic orbit. 

From the results of this section, it follows that the piecewise contractive character of 
the return map leads the stable dynamics to be asymptotically periodic. However, it does 
prevent the network from exhibiting a dynamics that can seem chaotic when observed at 
finite time scales. The richness of this dynamics depends on the interrelations between 
the stable set and the chaotic set. If the asymptotic sets of the stable dynamics remain 
far from the discontinuities of the return map, then numerical simulations should observe 
a stable periodic behavior. But, in the other case, this periodic behavior may be not 
observed at finite time scales and/or in presence of perturbations, for an important set of 
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initial states of the network. Also, non periodic attractors exist in the sensitive set and 
can coexist with the periodic attractors of the stable set. 



5.4 Proof of Proposition 5.9 

To prove Proposition 5.9 we introduce the so-called atoms of a set S v . For all i € Iq, we 
define Fi : P(E*) — > P(E*), where P(£*) denotes the set of all the subsets of £*, by: 

Fi(E) = P (EnX* {i} nS v ) VficE*. 
Given k E N and 12, ■ ■ ■ , ik) E Iq , we call atom of generation k the set 

A ili2 ... ik = F ik o J F ife _ i o • • • o F h (E* {il} ) 

and we call family of the atoms of generation k the set At = {Ai^^., (i\,i2, • • • ,ik) £ 
Io fc }- Note that the forward invariance of S v by p ensures that any atom is contained in 
S77. 

Lemma 5.10. For all k E N, we /iaue 

i) //V E S^, £/&en p fc (V) belongs to an atom of generation k. 

ii) Any atom of generation k + 1 is contained in an atom of generation k. 

Hi) Denotes diam(j4) the diameter of A and let d^ = max diam(j4). Then lim d^ = 0. 

Proof, i) It follows from the forward invariance of and from the inclusion S v C |J Sri 

iei 

stated in (37). Assume that there exists V £ Then, there exists i\ E Iq such that 
V E E* , n S„. It follows that 

p(V)Ep(E| ii} n,S,) = P il (E^ } )E^ 1 . 

By induction, suppose that p fc (V) belongs to Ai x ___i k E *4fc. From (37) it follows that 
p k (V) E 

^{jfc+i} ^ ^ ^ or some ik+i E Jo- Using the induction hypothesis we obtain 

/ +1 (V) e p(z\ ik+l} n5,n ^...ij = F lk+1 o...oF n (S| il} ) e 

n) Let Aiii 2 ...i fc+ i be an atom of generation /c + 1. Then, 

^iiia-ifc+i = F ik+i °---°F i2 o F h (E* {ii} ) 
C P ifc+1 o...oP, 2 (E*) 

c ^ + i°^ -°4(% } )e4 

ra) It is enough to show by induction that 

diam(yl) sC A fc_1 diam(E*) VA E A k - (38) 
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Since any atom is a subset of £*, it is true for k = 1. Assume (38) is true for k = fco- 
Take A = A hi2 „ Ak G A ko+ i and V, W G A. Then A = n SI , n 5^) where 
A' = A hi2 „ Ako G A - Therefore, there exists V, W G £| ifc +i} n A' such that V = p(V') 

and W = p(W'). Applying the contraction property and the induction hypothesis we 
obtain: 

|| V - W|| = Hp(V') - p(W')|| ^ A||V - W'|| Adiam(A') < A fco diam(£*), 
which implies the desired result, since V and W are arbitrary in the atom A. □ □ 
Lemma 5.11. There exists k^l such that if A G At then A C Sr^ for some i G Iq. 

Proof. Let k 1 such that d k < rj/2 and A G Ak not empty. Take V G A and i £ Iq such 
that V G S| i} (recall A C S,, and (37)). Let E = £* \ £|. } and let dE be its boundary. 
We denote d(V, i£) the distance between the point V and the set E. We have: 

d(V,E) = d(V,dE) = d(V,SE| i} ) ^ d(V,3P*) ^ jj. 
Let W G A then d(W, V) < diam A < d fc < r?/2 and from 

d(W, £?) ^ d(V, £) - d(W, V) ^ t? - | > 

we deduce that W (I E. Then W G £?.,. □ □ 

Remark 5.12. The number of iteration k of the return map that ensure that any atom 
of generation k of S v is included in a continuity piece of the return map depends on r\. 
This number is an upper bound on the transitory time for all the orbits of to enter in 
the attraction basin of a limit cycle and on the period of this cycle. When rj increases this 
upper bound decreases. The largest transitory times and the largest period are therefore 
those of the points of the sets S v with the smallest r\. 

Lemma 5.13. If there exist (io,ii, • • • , %>-i) G Iq and a family of sets Bq, B±, . . . , -B p _i 
satisfying 

i) B k C £{i fc } for all k G {0, . . . ,p — 1} and 

ii) p(B p -i) C -B and p{B k _i) C B k for all k G {1, . . . ,p - 1}, 

then there exists a unique periodic point of period p in Bq whose orbit is the u- limit set 
of any point contained in the union of the B k 's. 

Proof: Since by i) each B k is contained in a contractive piece of p, by ii) the map pP is 
contractive in Bq and p^(Bq) C Bq. Then, by the fixed point theorem of Banach, there 
exists a unique periodic point V of period p in Bq. 

We prove now that if V G B k , then w(V) is the orbit L of V. Without loss of generality 
we can assume V G Bq. It is enough to show that w(V) = w(V), since the w-limit set of 
a periodic point coincides with its orbit. 
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Let be a sequence of natural numbers such that lim pj = +00 and such that 

either lim /^(V) or lim fP j (y) exists. Since V and V belong both to Bq, according 

j— >oo j— >oo 

to ii) pPi (V) and p Pj (V) belong to the same continuity piece for all j G N. Using the 
contraction property we obtain: 

lim ||p^(V) - // J (V)|| lim A«||V - V|| = 0. 

j—>oo j— >oo 

It follows that both lim pPi (V) and lim pPi (V) exist and are equal. This proves that 

j—¥oo j—^oo 

w(V) = w(V) as wanted. □ 

Proof of Proposition 5.9: Step 1 Let k G N be such that the thesis of Lemma 5.11 is true. 
We show that the image by p of any atom of At is contained in an atom of At. Suppose 
A G A^. By Lemma 5.11, there exists i G Jo such that A C an d since any atom 

is contained in S v , we have p(A) = p(A H n 5.^) = ^(A). Then, p(A) G and 
according to ii) of Lemma 5.10 it is included in an atom of At- 

Step 2 Let V G S v and W = p k (V). Then, from i) and ii) of Lemma 5.10 we deduce 
that each point of the orbit of W belongs to an atom of Af.. Being the number of atoms 
in A k finite, it must exist Bq G A k such that p 3o (W) G Bq and />" )+p (W) G .Bo for some 
jo and p G N. Let's denote B±,B2, . . . ,-Bp-i the atoms of that contain respectively 
pjo+ l (W),p jo+2 (W), . . . ^o+p-^W). By Step 1, the image by p of each of these atoms 
is contained in an atom of Ay so they must satisfy: 

piBp^GBo and C B k V k G {1, . . . ,p - 1}. 

Moreover, by Lemma 5.11 there exists («o, • • • , ip-i) G ^0 sucn that C S* fe for all 
^5 k ^ p — 1. Therefore, this family of atoms satisfy the hypothesis of Lemma 5.13. 
bmce /r^ (V) G Bq and cj(V) = u(p k+jo {V)), we conclude that w(V) is a periodic orbit 
of period p contained in the union of the atoms B k s. Note that it may exit at most jfcAt 
different families satisfying Lemma 5.13 and thus at most 4fAj, different periodic orbits in 

Step 3 We have shown that the w-limit set of any point of 5^ is a periodic orbit contained 
in S v . We finish the proof of the propostion by showing that any periodic orbit in is 
actually a limit cycle. 

Suppose V is a periodic point of period p and let L = {V,p(V), . . . , p p_1 (V)} C S v 
be its orbit. We have to prove that there exists an open neighborhood of L which points 
have L as w-limit set (i.e, the basin of attraction of L contains an open neighborhood of 
L). For all k G {0, . . . ,p — 1} we have p k (V) G ^|j fc } where (ii, ... ,i p ) G Iq. Since the 
continuity piece ^% k y is open, there exists an open ball B(p k (V), a k ) of center p k (V) and 
radius a k > whose closure is contained in ^% k y Let < a < min{afc, ^ k ^ p — 1} 
and B be the open neighborhood of L defined by: 

p-l 

B=\jB k where B k = B(p k (V),a) V k G {0, . . . ,p - 1}. 

fc=0 
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We have Bk G ^{i fe }' ano - ^ we show that p(B p -x) C -Bo and p(Bk-i) C Bk for all 
k G {0, ... ,p— 1}, then we can apply Lemma 5.13 to prove that the open set B contains a 
unique periodic orbit (L) which is the w-limit set of all the points of B. We will only prove 
that p(B p _x) C B , the other inclusions admit an analogous proof. If V G B p _x then V 
and p p ~ 1 CV) belong to the same piece of continuity EJ. v Applying the contraction 
property of p we obtain: 

||p(V) - /(V)|| < A||V - ff-'WW <Xa<a. 

In other words ||/o(V) — V|| < a which implies p(V) G Bq. □ 

6 Conclusion 

In the present paper, we gave a mathematical analysis of the dynamics of IF neural 
networks, with an arbitrary number of neurons interacting by instantaneous excitations 
and inhibitions. The main purpose was to give a global analysis describing the asymptotic 
behavior of all the solutions of the model. 

Our study is in part motivated by the comparison of continuous time IF neural networks 
with discrete time versions, such as those analyzed in [9]. An important characteristics of 
the model of [9] is that it is piecewise contractive in the whole the phase space. In our 
case where time is continuous, we show that the associated return map does not fulfill 
this property trivially. In particular, we found sets of parameters where the return map 
exhibits expansion and has a repulsive periodic orbit. It is therefore necessary to impose 
some conditions on the parameters values for the return map to be piecewise contractive 
in the whole phase space. We have proposed such conditions through the hypothesis 
(H3), which states that the interactions have to be sufficiently strong, or equivalently, the 
resistance of the neural membrane R and/or the external current I ex t sufficiently weak. 
However, since it is a non-trivial task to find parameters for which the return map exhibits 
real expansion, there certainly exist other sets of parameters than those defined by (H3), 
for which the return map is piecewise contracting in the whole phase space. 

The property of piecewise contraction is mainly relevant to analyze the behavior of 
networks containing inhibitory neurons. We also study the dynamics of networks exclu- 
sively composed of excitatory neurons. For these networks, we only assume that all the 
interactions are strictly positive. We show that if the number of neurons is sufficiently 
large then, for any initial state, the network gets synchronized in a finite time. These 
results complete the work of [23], since we allow the weights of the excitatory synapses 
to be mutually different, while in [23] all the interactions are equal to a same constant. 
The number of neurons that are necessary to provoke this global synchronization, as well 
as the duration of the transient regime, is a decreasing function of the minimum positive 
value of the interactions. We show in concrete examples, that if the number of neurons is 
not large enough, then the global synchronization does not occur, since the network also 
presents some non synchronized periodic orbits. The relevance of the number of neurons 
(connections) for the synchronization has also been observed in [12] where the effectiveness 
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of the connections between neurons is modeled by a random variable. The synchroniza- 
tion is observed for high probability of connection. But if this probability is small, then 
asynchronous states appear. 

Coming back to the region of parameters defined by (H3), we have shown that the 
return map of a network containing inhibitory neurons, satisfies a general definition of 
piecewise contractive map (Definition 5.2). To analyze the asymptotic dynamics of such 
maps, we define two complementary sets of the phase space: the stable set and the sensitive 
set. The stable points fulfill a criterion of stability which is weaker than the negativeness 
of all the Lyapunov exponents. Our criterion is well defined even for maps which are 
neither differentiable nor continuous, and it is satisfied in particular by the maps with 
negative maximal Lyapunov exponent. On the other hand, the orbit of a sensitive point 
can be drastically modified by some arbitrarily small perturbations which change the firing 
neurons. The sensitive set contains all the points whose orbit gets arbitrarily near to the 
discontinuities set of the return map. 

We show that the stable set of a piecewise contractive map contains a countable number 
(possibly infinite) of limit cycles such that the union of their basins of attraction contains 
all the stable points. It results that the asymptotic dynamics of a network with a stable 
initial state is periodic. The limit cycles are persistent under deterministic and stochastic 
perturbations, provided that their amplitude is small enough. Nevertheless, not all the 
limit cycles have the same stability, in particular, those that are near to sensitive points, 
can be destroyed by small, but non infinitesimal, perturbations. An orbit approaching 
them can therefore suffer a drastic change under the influence of a small perturbation. 
This perturbation typically changes the basin of attraction the orbits belongs to, and it 
enlarges the transient time necessary to reach a limit cycle. Moreover, these "weakly" 
stable cycles have the longest transient times to approach them and the largest periods. 
In the extreme case where the stable set contains an infinite number of limit cycles, an 
infinity of them are concentrated near to sensitive points. It results that these limit cycles 
attract a large region of the phase space, and that their experimental observation needs 
high precision and large time scales. The existence of very long disordered transients in 
a stable dynamics has been described as stable chaos in [24] or virtual chaos in [9] and 
has been observed in numerical simulations of neural networks in [9], [29] and [30)], for 
instance. 

On the other hand, the characterization of all the possible attractors of the sensitive 
set is still an open question. Nevertheless, it is known that for one dimensional piecewise 
contractive maps the attractor of the sensitive points is essentially a Cantor set. Also, in [8] 
it has been reported that in higher dimension, other kind of attractors with a cardinality or 
a complexity lower or higher than the one of a Cantor set can exist. None of the examples 
described in [8] contains periodic orbits. We can therefore expect that the asymptotic 
periodic dynamics of stable IF neural networks can coexist with a non periodic sensitive 
dynamics. The coexistence of stable and sensitive dynamics in the same system, as well 
as the abundance of stable chaos, depend on how intricate are the sensitive set and the 
stable set and on their respective size. 

It is mainly admitted that the existence of strong chaos needs expansivity. We have 
shown that IF neural networks can have such a property. Our main purpose was to 
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show that some conditions were needed for the return map to be piecewise contractive. 
However, it would be interesting to make a deeper study of the phenomenon of non global 
contraction or expansivity, in some region of the phase space, as in Theorem 2. Although 
our result is stated in a different way, its proof relies on the existence of a repulsive periodic 
orbit. We think that it is possible to find more of these orbits, which would be a further 
step in the research of chaos in neural networks. 

To sum up, in the present paper we give a rigorous analysis of the asymptotic dynamics 
of a family of IF neural networks. Our analysis is principally qualitative and proved under 
well posed hypothesis, which can certainly be relaxed. In particular, the results about the 
stable dynamics of the networks under study are proved in some region of the parameters, 
where the return map is a piecewise contraction. But these results apply to any piecewise 
contractive map satisfying the general Definition 5.2. Therefore, Proposition 5.9 and 
Theorem 5, as well as their consequences, will then be true for any neural network (possibly 
more sophisticated) in the parameters region where its return map satisfies Definition 5.2. 
Also, the proofs of the principal theorems and propositions give some hints to obtain more 
quantitative results. We hope that the results of the present paper have helped to identify 
some important concepts and to pose some basis of future studies. 



7 Appendix: Some technical proofs. 
7.1 Proof of Lemma 3.3 

Let i j € I- To prove the Lemma 3.3, we suppose the neurons i and j satisfy the four 
conditions (01), (02) and (03) stated before the lemma. 

Step 1: We show that Tj C that is to say J(V) = I \ {j} (to prove Tj C 

just permute i and j). Suppose V 6 fj. Then, V k < V% for all k ^= i and the neuron i 
is the only neuron which reaches the threshold spontaneously at time U{V) = t(V). It 
implies that V G Sj and Jo(V) = {i} (recall (9)). 

Now let us compute the set of the neurons that fire by interaction with the neuron i 
at time i(V). Let k & I\ Jo(V) = I \ {i}, then using (8) with V k = we obtain 

4 W (V) + £ H lk = #CV)(v) +Hih = p- ^1 + H lk , 

ZGJo(V) : H lk >0 P 1 

which belongs to (Hik,c* + H^) since Vi G (c*,9). If k ^ j, then k £ and by 

hypothesis (02) we have H{ k > 9. Therefore, k G Ji(V). If k = j, by hypothesis (01) we 
have H ik < c* - 9 and k $ Ji(V). We deduce that Ji(V) = I\ {j}. 

Now let us compute the set of the neurons that fire by interaction with the neuron of 
Ji(V) at time t(V). Let k £ I \ Ji(V) = {j}, then using (8) with Vj = and (01) we 
obtain 

4 (V) ( V )+ E H lk = ^ (V) (V)+ H H <c* + 9-c* = 9. 

leJi(V) : H lk >0 l^j:H h >0 
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It follows that j <£ J 2 (V). We deduce that J 2 (V) = Ji(V) = / \ {j} and then J(V) = 

AO'}- 

Step 2: We show that there exists (a,b) C (c*,6) such that for all V G Tj verifying 
Vi G (a, b) we have p(V) G Tj. Suppose V G Tj. From step 1, we have C Enw, 
which implies jOfe(V) = for all k ^ j. Remains to show that for some c* < a < b < 9, if 
Vi G (o,6) then ^(V) G (c*,0). 

Since, i(V) = ij(V) using (8) we obtain 

p j (V) = g j (V i ) where gj -(x) := (3 - ^ ~ ^ +Y, H U Vx^P- 



The function gj being strictly decreasing, gj(x) G (gj(9), 9j{c*)) for all x G (c*,6>). By 
(03) we have gj(c*) = c* + Y^i^j^ij > c * an d by (01) we have gj(c*) < 9. It results 
that gj{c*) G (c*,9). Thus, the function gj being continuous there exists (a, b) C (c*,9) 
such that gj(x) G (c*,0) for all x G (a, 6). It follows that Pj(V) = gj(Vi) G {c*,9) for all 
Vi G (a, 6), which is the desired result. 

Note that gj is injective in (c*, 9), so /> is injective Tj. This ends the proof of the Lemma 
3.3. 



7.2 Proof of Theorem 3 

Lemma 7.1. Under the hypothesis (H1),(H2),(H3) and (H4) i/iere exists c > suc/i i/ioi 
/or a// n G N 



|| p n(V) - p"(W)|| < cA"||V - W|| if V, W G P Jo ... Jn := f| ^(EjJ 

i=0 

where Jq, . . . , J n G P (J) and A is i/ie contraction constant of p in the contractive zone S*. 
Proof. Consider the integer p of Proposition 3.9 and define for all k G {0, . . . ,p} 

c k ~ max su J WP k (V)-p k (W)\\ y, W£Pj 1 
fc " J ,..™P(/) P \ A fc ||V- W|| ' ^ Jo—Jk J 

where P Jo ... Jfc = f]^). 

i=0 

Let us show that c& is bounded for all k G {0, ...,£>}. Fix a A; G {0, and 
let Jo,..., Jfc G P(I)- The Poincare map p being Lipchitz continuous on each by 
construction of Vj ...j k , the composition p k is also Lipchitz continuous on Vj ...j k . Then, 
there exists a constant L > such that 

||/(V) - /(W)|| < L\\V - W|| VV, W G P Jo ...j k , 
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and as a consequence 

\\pk(V)-pk(w)\\ L 
v?wev Jo ... Jk A*||V-W|| ^A*' 

It follows that Cfc is bounded for all k £ {0, . . . ,p\ and c := max ct exists. 

ke{o,..., P } 

Let n G N and Jo, . . . , J n £ P(-0- If n ^ Pt then by definition of c 

||p n (V) - p n (W)|| < cA n ||V - W|| if V, W G P Jo ... Jn . (39) 

If n > p, take (39) as an induction hypothesis. Let J n +i £ P (J) and suppose V, W G 
Vj ...j n+1 - As n ^ p by Proposition 3.9 and Proposition 3.8 we have p n (E) C E*. There- 
fore, p n (V) and p n (W) G E* n E Jn . From Proposition 3.6 it follows 

||p n+1 (V) - /) n+1 (W)|| < A||p n (V) - p n (W)|| 

and from the induction hypothesis we obtain 

\\p n+1 (\) - p n+1 (W)|| < cA n+1 ||V - W||. 

□ □ 

Let A < fx < 1 and let no G N be such that c I -p I < 1. Consider the metric d 



defined by 

i( V,W):= - fmiiffl VV.W.E- 

and the partition V' of E defined by P' := {Pj ...j„ , Jo • • • J no £ P(-0}- To prove the 
theorem it is enough to show that p is piecewise contractive in E with respect to V' for 
the metric d. This is the purpose of the following calculation. First, note that for all V, 
W in E, we have: 



™ WpHV) - pHW 

d(p(v),p(w)) = J2 — 



_ 2(v,w ) + m^!gl _||v-w| 

Now, suppose V and W in Vj ...j nQ for some Jo • • • J no £ P(J). Then, applying Lemma 
7.1 we obtain: 

d(p(v), p(w)) < fi (d(y, w) + c || v - w|| - || v - w| 

By definition of p and no, we have then 

d(p(V),p(w)) <kv,w) 
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which ends the proof of Theorem 3. 
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